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© In variably magnifying and outputting an image, 
proper .variable magnification processing is per- 
formed with respect to a character/line draw compo- 
nent and a pseudo-halftone component, respectively. 
A binary image acquired by a binary image acquir- 
ing unit is supplied to an image area separating unit, 
in which the binary image is separated into a char- 
acter/line draw area and a pseudo-halftone area. An 
image in the character/line draw area is supplied to 
an outline variable magnification unit, which performs 
extraction of outline vector data, smoothing process- 



ing thereof, and reproduction processing of a binary 
image. An image in the pseudo-halftone area is 
supplied to a pseudo-halftone image variable mag- 
nification unit, in which the image is subjected to 
multivalue conversion processing in units of pixels, 
variable magnification processing by thinning or in- 
terpolation of pixels, and binarization again. A syn- 
thesizing unit synthesizes binary images output from 
these variable magnification unit and outputs the 
synthesized image to a binary image output unit. 
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BACKGROUND OF THE INVENTION 

The present invention relates to an image process- 
ing method and apparatus which extract the con- 
tours of a bit map image such as a binary image, 
and execute smoothing and variable magnification 
processing. 

As a resolution conversion technique for a digi- 
tal binary image in an image processing or image 
communication apparatus, an SPC (Selective Pro- 
cessing Conversion) method, a projection method, 
or the like has been proposed or used. In the SPC 
method, in accordance with the variable magnifica- 
tion of an image, each pixel of an original image is 
used the number of times corresponding to the 
magnification, or pixels are periodically thinned out, 
thereby performing resolution conversion (Matr 
sumoto and Kobayashi, "Study on the Effect of the 
Resolution Conversion on Picture Quality", The 
Journal of The Institute of Image Electronics En- 
gineers of Japan, vol. 12, No. 5, pp. 354 - 362, 
1983). In the projection method, an original image 
is projected onto a conversion image plane having 
a different line density, and the integral value of 
each pixel within the plane is binarized by thresh- 
old logic, thereby determining the value of each 
pixel of a conversion image (Arar and Yasuda, "A. 
Study on Facsimile Line-Density Conversion. 
Scheme", The Journal of The Institute of Image 
Electronics Engineers of Japan, vol. 7, No. 1, pp. 
11 - 18, 1978). 

As resolution conversion and smoothing tech- 
niques for a binary image, smoothing performed by 
referring to a pattern of pixels around a target pixel 
(Imanaka, et al. f "Improvement in Image Quality by 
Smoothing Processing of Facsimile Reception Im- 
age", The Proceedings of the Institute of Image 
Electronics Engineers Conference, No. 18, 1991) 
and the like have been proposed and used for an 
image processing communication apparatus and 
various peripheral units. 

In the above resolution conversion method, 
however, in performing conversion at a high mag- 
nification, a curved portion of an image becomes a 
stepped portion. That is, a deterioration in image 
quality cannot be avoided. In addition, the resolu- 
tion conversion and smoothing techniques per- 
formed by referring to an adjacent pixel pattern are 
effective only for fixed magnifications, e.g., x2 and 
x4, with respect to a target pixel in the main 
scanning and sub-scanning directions of an image. 

In order to solve the above problems, there is 
provided an outline smoothing method, in which 
the link of a black image (in a case wherein a 
binary image is constituted by a white or black 
image) is extracted as vector data instead of di- 
rectly processing a binary image in the form of a 



bit map, and processing such as variable mag- 
nification/smoothing is subsequently performed 
with respect to contour vector data, thereby obtain- 
ing a high-quality image. 

5 In such variable magnification processing, if 

contour vector data is given as coordinate data, 
each coordinate data may be magnified in accor- 
dance with a desired magnification. In performing 
smoothing processing afterward, pattern matching 

10 is performed between a target vector, of the ex- 
tracted vectors, which is to be subjected to 
smoothing processing and a contour vector adja- 
cent to the target vector so as to redefine the 
contour vector, thereby performing removal of iso- 

75 lated points, notches, and the like, smoothing of 
jagged (jagged pattern) smoothing processing, and 
the like. 

By using the above outline smoothing method, 
an image having relatively high quality can be 
. 20 obtained at an arbitrary magnification between a 
low magnification and a high magnification. In this 
method, however, the contour of an image is ex- 
tracted as vector data. For this reason, in process- 
ing a pseudo-halftone image produced when, for 
25 example, a photographic image is expressed as a 
binary image, even isolated pixels and fine curves 
necessary for halftone expression are subjected to 
smoothing/variable magnification processing upon 
extraction of contour vectors. Therefore, the density 
30 of a pseudo-halftone image cannot be maintained 
after resolution conversion, resulting in a deteriora- 
tion in image quality. 

Isolated pixels and fine curves in halftone ex- 
pression are produced to delicately express the 
35 pixel density and curves of an image as halftone 
densities from a macroscopic viewpoint. Ideally, 
therefore, this density value is kept unchanged 
after resolution conversion. In the above outline 
smoothing method, however, since such isolated 
4Q • points and fine curves are removed or smoothed, 
the density value of a pseudo-halftone image 
changes after resolution conversion. 

In addition, in outline processing, since an im- 
age is treated as vector data using coordinate 
45 values, the amount of vector data becomes very 
large as compared with the capacity for original 
image data when an original image constituted by 
a large number of isolated points and black-coup- 
led elements each consisting of a small number of 
50 pixels, such as a pseudo-halftone image, is to be 
processed. As a result, for example, the required 
memory amount increases or the processing time 
is extremely prolonged. 

55 SUMMARY OF THE INVENTION 

The present invention has been made in con- 
sideration of the above problems, and has as its 
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object to provide an image processing apparatus 
and method which can obtain a high-quality image 
as a result of variable magnification processing by 
performing proper variable magnification process- 
ing of character/line draw components and pseudo- 
halftone components, respectively. In addition, it is 
an object of the present invention to provide an 
image processing apparatus and method which can 
reduce the memory capacity consumption while 
such processing is performed. 

The present invention has been made in con- 
sideration of the prior art, and has as its another 
object to provide an image processing method and 
apparatus which can maintain the halftone density 
of image data even after smoothing processing or 
resolution conversion. 

It is still another object of the present invention 
to provide an image processing method and ap- 
paratus., which can maintain the density of image 
data after resolution conversion by performing res- 
olution ^conversion so as not to perform smoothing 
processing with respect to, e.g., isolated pixels and 
corner portions of image data. 

The present invention has been made in con- 
sideration of the prior art, and has as its still 
another object to provide an image processing 
method and apparatus which can obtain a high- 
quality magnified image even when a determination 
error occurs with respect to a character/line draw 
component and a pseudo-halftone component. 

It is. still another object of the present invention 
to provide an image processing method and ap- 
paratus which form two images from an input im- 
age by performing proper variable magnification 
processing with respect to character/line draw com- 
ponents and pseudo-halftone components, respec- 
tively, and selecting/synthesizing the. two images 
upon image area determination. 

It is still another object of the present invention 
to provide an image processing method and ap- 
paratus in which black pixels input for variable 
magnification suitable for character/line draw com- 
ponents are limited to a black pixel determined as 
a character/line draw component and black pixels 
adjacent thereto, thereby suppressing an increase 
in required memory capacity and processing time 
even while such processing is performed. 

Other features and advantages of the present 
invention will be apparent from the following de- 
scription taken in conjunction with the accompany- 
ing drawings, in which like reference characters 
designate the same or similar parts throughout the 
figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the arrange- 
ment of an image processing apparatus accord- 
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ing to the first embodiment of the present inven- 
tion; 

Fig. 2 is a block diagram showing the arrange- 
ment of an image area separating unit in Fig. 1; 

s Fig. 3 is a view for explaining processing per- 

formed by an isolated pixel determining unit of 
the image area separating unit; 
Fig. 4 is a view showing an area to be referred 
to by the isolated pixel determining unit; 

10 Fig. 5 is a view for explaining the contents of 

processing performed by a periodicity determin- 
ing unit of the image area separating unit; 
Fig. 6 is a view for explaining processing per- 
formed by a high-frequency component deter- 

75 mining unit of the image area separating unit; 

Fig. 7 is a block diagram showing the arrange- 
ment of a data holding unit of the image area 
separating unit; 

Fig. 8 is a block diagram showing the arrange- 
20 ment of a pseudo-halftone image variable mag- 
nification unit in Fig. 1 ; 

Fig. 9 is a view for explaining inverse quantiza- 
tion processing in the pseudo-halftone image 
variable magnification unit; 
25 Fig. 10 is. a block diagram showing the arrange- 
ment of an outline variable magnification unit in 
Fig. 1; 

Fig. 1 1 is a block diagram showing the arrange- 
ment of a synthesizing unit in Fig. 1; 

30 Fig. 12 is a block diagram showing the arrange- 
ment of an apparatus according to the third 
embodiment of the present invention; 
Fig. 13 is a block diagram showing the arrange- 
ment of an apparatus according to the fourth 

35 embodiment of the present invention; 

Fig. 14 is a block diagram for explaining outline 
vector extraction processing; 
Fig. 15 is a view for explaining outline vector 
extraction processing; 

40 Fig. 16 is a view for explaining outline vector 

extraction processing; 

Fig. 17 is a view for explaining outline vector 
extraction processing; 

Fig. 18 is a view showing the format of extracted 
45 coarse contour vector data; 

Fig. 19 is a block diagram showing the arrange- 
ment of an outline smoothing/variable magnifica- 
tion unit; 

Fig. 20 is a block diagram showing the arrange- 
so ment of a system; 

Fig. 21 is a flow chart showing a procedure for 
image processing; 

Fig. 22 is a view showing an example of the first 
smoothing processing; 
55 Fig. 23 is a view showing a data format after the 
second smoothing processing; 
Fig. 24 is a view showing an example of the 
second smoothing processing; 

3 
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Fig. 25 is a view showing an area referred to by 
an inverse quantization processing unit and co- 
efficients set in the area in the seventh embodi- 
ment of the present invention; 

Fig. 26 is a view showing another area referred 5 
to by the inverse quantization processing unit 
and other coefficients set in the area in the 
seventh embodiment; 

Fig. 27 is a block diagram showing the sche- 
matic arrangement of an image processing ap- w 
paratus using an outline smoothing method ac- 
cording to the eighth embodiment of the present 
invention; 

Figs. 28A and 28B are views for explaining 
smoothing processing in a first smoothing unit; 75 
Fig. 29 is a view for explaining smoothing pro- 
cessing in the first smoothing unit; 
Fig. 30 is a view for explaining smoothing pro- 
cessing in the first smoothing unit; 
Fig. 31 is a view for explaining smoothing pro- 20 
cessing in the first smoothing unit; 
Fig. 32 is a view for explaining binary image 
reproduction processing in the ninth embodi- 
ment of the present invention; 

Fig. 33 is a block diagram showing the sche- 25 
matic arrangement of an image processing ap- 
paratus using an outline smoothing method ac- 
cording to the tenth embodiment of the present 
invention; 

Fig. 34 is a block diagram showing the sche- 30 
matic arrangement of the image processing ap- 
paratus using the outline smoothing method ac- 
cording to the tenth embodiment; 
Fig. 35 is a block diagram showing the arrange- 
ment of an image processing apparatus accord- 35 
ing to the eleventh embodiment of the present 
invention; 

Fig. 36 is a block diagram showing the arrange- 
ment of an image area determining unit in the 
eleventh embodiment; 40 
Fig. 37 is a view for explaining isolated central 
pixel determination processing in image area 
determination; 

Fig. 38 is a block diagram showing the arrange- 
ment of an outline extraction image forming unit 45 
in the eleventh embodiment; 
Fig. 39 is a view for explaining the contents of 
processing performed by a data holding unit of 
the outline extraction image forming unit; 
Fig. 40' is a block diagram showing the arrange- so 
ment of an outline variable magnification unit in 
the eleventh embodiment; 
Fig. 41 is a view for explaining inverse quantiza- 
tion processing in a pseudo-halftone variable 
magnification unit; 55 
Fig. 42 is a view for explaining inverse quantiza- 
tion processing Jn the pseudo-halftone variable 
magnification unit; 



Fig. 43 is a block diagram showing the arrange- 
ment of a selecting/synthesizing unit in the elev- 
enth embodiment; 

Fig. 44 is a block diagram showing the arrange- 
ment of an image processing apparatus accord- 
ing to the thirteenth embodiment of the present 
invention; and 

Fig. 45 is a block diagram showing the arrange- 
ment of a selecting/synthesizing unit in the four- 
teenth embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The assignee of the present application has 
already made the following proposals as Japanese 
Patent Application Nos. 3-345062 and 4-169581. 

In each of these proposals, when a binary 
image is to be variably magnified and output, the 
contour information of the binary image is extract- 
ed, and a magnified image is formed on the basis 
of the extracted contour information instead of vari- 
ably magnifying the binary image itself. It is an 
object of each proposal to obtain an image with 
high quality. 

More specifically, in Japanese Patent Applica- 
tion No. 3-345062, outline vectors are extracted 
from a binary image, a magnifying operation is 
performed at a desired (arbitrary) magnification in 
the state of the extracted outline vector expression 
to form smoothly magnified outline vectors, and a 
binary image is reproduced from the smoothly 
magnified outline vectors. With this operation, a 
high-quality digital binary image magnified at a 
desired magnification is obtained. 

The main part of this proposal will be briefly 
described below. Fig. 14 is a block diagram most 
properly representing the characteristic features 
disclosed in Japanese Patent Application No. 3- 
345062. 

Referring to Fig, 14, reference numeral 1 de- 
notes a binary image acquiring unit for acquiring a 
digital binary image to be subjected to variable 
magnification processing, and outputting a binary 
image according to a raster scanning scheme; 2, 
an outline extracting unit for extracting coarse con- 
tour vectors (outline vectors before smooth- 
ing/variable magnification processing) from the bi- 
nary image of the raster scanning scheme; 3, an 
outline smoothing/variable magnification unit for 
performing smoothing/variable magnification pro- 
cessing of the coarse contour vectors in the form 
of vector data; 4, a binary image reproducing unit 
for reproducing binary image data of the raster 
scanning scheme from outline vector data; and 5, a 
binary image output unit for displaying the binary 
image data of the raster scanning scheme, produc- 
ing a hard copy, or outputting the data to a com- 



MSDOCID: <EP 0650287A2_I_> 



7 



EP 0 650 287 A2 



8 



munication line or the like. 

For example, the binary image acquiring unit 1 
is constituted by a known raster scanning type 
binary image output unit for reading an original 
image as a binary image and outputting the read s 
image according to the raster scanning scheme. 
For example, the outline extracting unit 2 is con- 
stituted by a device disclosed in Japanese Patent 
Application No. 2-281958 previously proposed by 
the assignee of the present application. Fig. 15 w 
shows a scanning form for raster scanning type 
binary image data output from the binary image 
acquiring unit 1, and also a scanning form for 
raster scanning type binary image data received by 
the outline extracting unit 2. In this form, the outline 15 
extracting unit 2 receives raster scanning type bi- 
nary image data output from the binary image 
acquiring unit 1. Referring to Fig. 15, reference 
numeral 101 denotes a given pixel of a binary 
image during a raster scanning operation; and 102, 20 
a nine-pixel area including eight pixels adjacent to 
the pixel 101. The above outline extracting unit 
disclosed in Japanese Patent Application No. 2- 
281958 switches target pixels in the raster scan- 
ning order, and detects a contour side vector (hori- 25 
zontal or vertical vector) between each target pixel 
and each adjacent pixel in a nine-pixel area de- 
noted by reference numeral 102 in accordance with 
the state of each pixel (white or black pixel). If a 
contour side vector is present, the outline extract- 30 
ing unit extracts the start coordinates and direction 
data of the side vector, and sequentially extracts 
coarse contour vectors while updating the relation- 
ship in connection between these side vectors. 

Fig. 16 shows a state wherein contour side 35 
vectors between a target pixel and pixels adjacent 
to the target pixel are extracted. Referring to Fig. 
16, a mark A represents the start point of a vertical 
vector (or the end point of a horizontal vector), and 
a mark O represents the start point of a horizontal 40 
vector (or the end point of a vertical vector). 

Fig. 17 shows coarse contour vector loops ex- 
tracted by the outline extracting unit described 
above. In this case, each square defined by the 
matrix indicates a pixel position of an input image; 45 
each blank square, a white pixel; and each hatched 
mark O, a black pixel. Similar to Fig. 16, each 
mark A represents the start point of a vertical 
vector; and each mark O, the start point of a 
horizontal vector. 50 

As is apparent from the case shown in Fig. 17. 
the outline extracting unit extracts areas where 
black pixels are coupled to each other as coarse 
contour vectors alternately (always alternately) con- 
tinuous with each other, although horizontal and 55 
vertical vectors differ in length. Note that in this 
case, extraction processing is performed such that 
a black pixel area is located on the right side with 



respect to the direction of the extraction process- 
ing. In addition, the start point coordinates of each 
coarse contour vector are extracted as the middle 
position of each pixel of an input image. That is, 
when the position of each pixel is expressed by 
integers (x.y), the start point of an extracted vector 
is expressed by values obtained by adding or 
subtracting 0.5 to or from the respective coordinate 
values. More specifically, a line portion having a 
width corresponding to one pixel in an original 
image is also extracted as a coarse contour vector 
having a significant width. 

The coarse contour vector group extracted in 
this manner is output from the butfine extracting 
unit 2 in Fig. 14 according to a data format like the 
one shown in Fig. 18. That is, the coarse contour 
vector group is constituted by a total number a of 
coarse contour loops extracted from an image, and 
a group of ; coarse contour loop data of the first 
contour loop to the ath contour loop. Each coarse 
contour loop data is constituted by the total num- 
ber of the start points of contour side vectors 
(equivalent to the total number of contour side 
vectors) -present in the coarse contour loop, and a 
sequence of the values (the start points of horizon- 
tal and vertical vectors are alternately arranged) of 
the start point coordinates (x- and y-coordinates) of 
the respective contour side vectors in the order of 
constituting the loop. 

The outline smoothing/variable magnification 
unit 3 shown in Fig. 14 receives the coarse contour 
vector data (Fig., 18) output from the outline extract- 
ing unit 2, and performs variable magnification pro- 
cessing for smoothing and a desired magnification 
in the form of outline vector data (coordinate val- 
ue). Fig. 19 shows the arrangement of the outline 
smoothing/variable magnification unit 3 in more de- 
tail. Referring to Fig. 19, reference numeral 310 
denotes a magnification setting unit; and 320, a 
first smoothing/variable magnification unit. 

The first smoothing/variable magnification unit 
320 performs smoothing and variable magnification 
processing of input coarse contour data at a mag- 
nification set by the magnification setting unit 310. 
A second smoothing unit 330 further performs 
smoothing of the processing result to obtain a final 
output. ' 

The magnification setting unit 310 may supply 
a value set by a dip switch, a dial switch, or the 
like in advance to the first smoothing/variable mag- 
nification unit 320, or may supply a value externally 
provided via an l/F (interface). That is, the mag- 
nification setting unit 310 is a unit for providing 
information designating specific magnifications re- 
spectively in the main scanning (horizontal) direc- 
tion and the sub-scanning (vertical) direction with 
respect to an image size supplied as input data. 
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The first smoothing/variable magnification unit 
320 receives magnification information from the 
magnification setting unit 310 and performs 
smoothing/variable magnification processing. 

Fig. 20 shows a hardware arrangement for re- 
alizing outline smoothing/variable magnification pro- 
cessing. Referring to Fig. 20, reference numeral 71 
denotes a CPU; 72, a disc unit; 73, a disc I/O; 74, a 
ROM for storing operation procedures executed by 
the CPU 71; 75, an I/O port; 76, a RAM (random 
access memory); and 77, a bus connected to each 
of the above blocks. 

The output (shown in Fig. 15) from the outline 
extracting unit is stored, as a file (coarse contour 
vector data), in the disc unit 72 according to the 
data format shown in Fig. 18. 

The CPU 71 operates in accordance with the 
procedure shown in Fig. 21 to execute outline 
smoothing/variable magnification processing. 

In step S1, the CPU 71 reads out coarse con- 
tour data from the disc unit 72 via the disc I/O 73, 
and loads it in a working memory area (not shown) 
of the RAM 76. In step S2, the CPU 71 performs 
first smoothing/variable magnification processing. 

The first smoothing processing is performed 
for each closed loop of the coarse contour data. 
Each contour side (horizontal or vertical vector) 
vector of each coarse contour data is sequentially 
set as a target vector, and at most three continuous 
side vectors before and after each target contour 
side vector (i.e., at most a total of seven side 
vectors, i.e., three sides before the target side and 
three sides after the target side) are classified into 
a pattern according to a combination of the lengths 
and directions of the side vectors. A contour point 
after the first smoothing processing as the first 
smoothing result with respect to each target side is 
defined with respect to each pattern. The CPU 71 
then outputs additive information (to be referred to 
as corner point information hereinafter) indicating 
the coordinate value of each contour point after the 
first smoothing processing and whether the contour 
point is a point at a corner. In this case, a "point at 
a corner" unit a point located at a' significant cor- 
ner, and is discriminated from points derived from 
noise and points derived from jagged portions and 
notches caused by other factors. A contour point 
(to be referred to as a corner point hereinafter) 
after the first smoothing processing which is deter- 
mined as a corner point is treated as a point which 
is not smoothed by the second smoothing process- 
ing, i.e., treated as a fixed point. In other words, a 
contour point (to be referred to as a non-corner 
point hereinafter) after the first smoothing process- 
ing which is not determined as a corner point is 
further smoothed by the second smoothing pro- 
cessing. 



Fig. 22 shows this state, i.e., a target coarse 
contour side vector Di, three side vectors Di-1, Di : 
2. and Di-3 before the target coarse contour side 
vector/three side vectors Di + 1, Di + 2, and Di + 3 
5 after the target coarse contour side vector, and a 
contour point after the first smoothing processing 
which is defined with respect to the target edge Di. 
That is, a vector (an oblique vector is allowed) 
connecting contours redefined in this manner is 

io formed. 

Figs. 28A to 31 show contour vector patterns 
and examples of how corresponding target contour 
vectors are redefined. 

Fig. 28A shows a case wherein a target vector 

15 700 located in the middle of five continuous con- 
tour vectors has a length of "1 ", vectors 701 and 
702 immediately before and after the target vector 
700 respectively have lengths of "-1" and "1", and 
each of vectors 705 and 706 two vectors before 

20 and after the target vector 700 has a length of "3" 
or more. 

Fig. 28B shows a case wherein a target vector 
700 located in the middle of five continuous con- 
tour vectors has a length of "1", vectors 703 and 
25 704 immediately before and after the target vector 
700 respectively have lengths of "1" and "-1", and 
each of vectors 707 and 708 two vectors before 
and after the target vector 700 has a length of "3* 1 
or more. Each of Figs. 28A and 28B shows a one- 

30 pixel notch unique to a binary image obtained by 
binarizing data read by an image reader or the like. 
In this case, when a contour vector is redefined, a 
contour point is defined upon elimination of the 
notch portion, thereby removing the notch. 

35 Referring to Fig. 29, reference numeral 810 

denotes an image in which notches are continu- 
ously produced. In this case, all the contour vectors 
have a length of "1". Contour vectors 805 and 802 
two vectors before and after a target vector 800 

40 point in the same direction. Contour vectors 805 
and 802 immediately before and after the target 
vector point in different directions, and so do con- 
tour vectors 806 and 803 three vectors before and 
after the target vector. 

45 Assume that a target vector is a horizontal 

vector. In this case, the x-coordinate value of the 
target vector is set to have the same value as that 
of the middle point of the target vector, and the y- 
coordinate value of the target vector is set to have 

so the same' value as that of the middle point of a 
contour vector immediately before the target vec- 
tor, thereby defining a contour point after the first 
smoothing processing. Assume that a target vector 
is a vertical vector. In this case, the x : coordinate 

55 value of the target vector is set to have the same 
value as that of the middle point of a contour 
vector immediately before the target vector, and 
the y-coordinate value of the target vector is set to 
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have the same value as that of the middle point of 
the target vector, thereby defining a contour point 
after the first smoothing processing. Referring Fig. 
29, reference numeral 811 denotes a contour ob- 
tained by smoothing the image 810. 

Fig. 30 is a view for explaining processing for 
making a moderately inclined portion more mod- 
erate- 
Assume that a target contour vector 901 has a 
length of "3°, and both contour vectors before and 
after the target vector 901 point in the same direc- 
tion and have a length of "1 In addition, assume 
that both contour vectors two vectors before and 
after the target vector 901 point in the same direc- 
tion and have a length of "1 ". In this case, the 
middle point of the target contour vector 901 is 
redefined as a contour point. With this operation, a 
stepped portion denoted by reference numeral 910 
in Fig. 30 is smoothed as indicated by a dotted line 
9 1 1 in Fig. 30. 

Fig 31 is a view for explaining processing for 
obtaining a sharp image by further smoothing in- 
clined Imo portion and retaining a corner portion 
tntact at £ position near a point of contact between 
the inclined ime portion and the fine corner portion. 
In this case, a target vector 920 is smoothed in the 
same manner as in Fig. 30. However, since a 
coniou- vector 921 immediately before the target 
vector 920 and a contour vector 922 before the. 
contour vector 921 indicate that a pixel indicated 
by a mar it is located at a corner portion (corner 
point), tins contour point is not subjected to the 
second smoothing processing (to be described 
later). Therefore, a portion, of the target vector 920, 
extending from its middle point in the main scan- 
ning direction is smoothed, as indicated by the 
dotted line in Fig. 31 . 

The above description is associated with pixel 
patterns to be subjected to the first smoothing 
processing, which is a general description of the 
processing executed by a smoothing unit 102 in 
this embodiment. Note that smoothing may be per- 
formed with respect to patterns other than those 
described above in practice. The processing in this 
first smoothing unit is the process of smoothing an 
image by pattern matching. Owing to this process-, 
ing. thickening, thinning, or the like of an image 
may occur in a small area corresponding to . about 
one pixel at most. 

The contents of the first smoothing processing 
have been described above. Data after the first 
smoothing processing are sequentially constructed 
on a predetermined area of the RAM 76. The 
processing in step S2 in Fig. 21 is completed in 
this manner, and the CPU 71 performs the second 
smoothing processing in step S3. 

In the second smoothing processing, data after 
the first smoothing processing is input and pro- 



cessed. That is, the CPU 71 receives data indicat- 
ing the number of closed loops, data indicating the 
number of contour points of each closed loop, the 
coordinate value data string of contour points of 
5 each closed loop after the first smoothing process- 
ing, and the additive information data string of the 
contour points of each closed loop after the first 
smoothing processing, and outputs contour point 
data after the second smoothing processing. 

70 ; As shown in Fig. 23, the contour data after the 
second smoothing processing is constituted by the 
number of closed loops, a contour point count table 
for each closed loop, and the coordinate value data 
of the contour points of each closed loop after the 

75 second smoothing processing. 

The second smoothing processing will be brief- 
ly described below with reference to Fig. 24. Simi- 
lar to the first smoothing processing, in the second 
smoothing processing, processing is performed in 

20 units of contour loops, while processing is per- 
formed in units of contour points in each contour 
loop. 

If a target contour point is a corner point, an 
input contour point coordinate value is used as 
25 contour point coordinate data which has undergone 
the second smoothing processing with respect to 
the target contour point. That is, no change is 
made. 

If a target contour point is a non-corner point, a 

30 coordinate value obtained from the weighted mean 
of the coordinate values of contour, points before 
and after the target contour point and the coordi- 
nate value of the target contour point is used as a 
contour point coordinate value which has under- 

35 gone the second smoothing processing with re- 
spect to the target contour point. More specifically, 
letting Pi(xi.yi) be the target input contour point as 
the non-corner point, Pi-1(Xi-1,yi-1) be the contour 
point immediately before the target contour point in 

40 the input contour loop, Pi + 1(xi + 1,yi + 1) be the 
contour point immediately after the target contour 
point, and QKx'i.y'i) of the contour point which has 
undergone the second smoothing processing with 
respect to the target input contour point Pi, 

45 . - 

x*i = ki-1 -xi-1 + ki*xi + ki + 1*xi + 1 
„ y'i = ki-1 •yi-l + ki - yi + ki + 1»yi + 1 (1) 

In this case, ki-1 = ki + 1 = 1/4 and ki = 1/2. 
so Referring to Fig. 24, points P0, P1, P2, P3. and 

P4 form a part of a series of continuous contour 
points, as input data, which have undergone the 
first smoothing processing, points P0 and P4 are 
corner points, and points PI, P2, and P3 are non- 
55 corner points. The processing results obtained at 
this time are respectively indicated by points Q0, 
Q1, Q2 ; Q3, and Q4. Since the points P0 and P4 
are corner points, their coordinate values are used 
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as the coordinate values of the points Q0 and Q4 
without any modification. The point Q1 has coordi- 
nate values calculated from the points P0, P1, and 
P2 according to the above equations. Similarly, the 
points G2 and Q3 respectively have coordinate 
values calculated from the points P1, P2, and P3 
and the points P2, P3, and P4 according to the 
above equations. 

The CPU 71 performs the second smoothing 
processing with respect to the contour data in- a 
predetermined area of the RAM 76, which has 
undergone the first smoothing processing, in the 
above-described manner. In the second smoothing 
processing, processing is sequentially performed 
for each loop in an order of the first loop, the 
second loop, the third loop.... When processing 
with respect to ail loops is completed, the second 
smoothing processing is ended. In each loop; pro- 
cessing is sequentially performed in an order of the 
first point, the second point, the third point.... When 
the processing indicated by equations (1) is com- 
pleted with respect all the contour points in one 
loop, the processing of this loop is ended, and the 
next loop is processed. 

Assume that L contour points are present in a 
loop. In this case, a point before the first point is 
the Lth point; and a point after the Lth point is the 
first point. The contour point data obtained by the 
second smoothing processing has the same total 
number of loops as that of the contour data after 
the first smoothing processing, with the number of 
contour points on each loop remaining the same. 
The CPU 71 outputs the above result to another 
area of the RAM 76 or the disc unit 72 according to 
the format shown in Fig. 23, and completes the 
second smoothing processing (step S3). 

The flow then advances to step S4 to transfer 
the data obtained by the second smoothing pro- 
cessing to the binary image reproducing unit 4 via 
the I/O port 75, thereby completing the series of 
operations shown in Fig. 21. 

For example, the binary image reproducing unit 
4 can be constituted by a device disclosed in 
Japanese s Patent Application No. 3-172098 pro- 
posed by the assignee of the present application. 
This device can output a binary image according to 
the raster scanning scheme, which image is formed 
by painting an area enclosed with a vector graphic 
pattern expressed by contour data, obtained by the 
second smoothing processing and transferred via 
an I/O, oh the basis of the contour data. In addition, 
according to the description of this proposal, binary 
image data is visualized by using a binary image 
output unit such as a video printer. 

The proposal disclosed in Japanese Patent Ap- 
plication No. 4-169581 is an improvement oh Japa- 
nese Patent Application No. 3-345062 described 
above. This proposal aims at preventing an image 
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magnified at a low magnification from excessive 
thickening. More specifically, in the outline extract- 
ing unit in Japanese Patent Application No. 3- 
345062, a boundary located midway between white 
5 and black pixels of an original image is set as a 
target subjected for vector extraction. In the im- 
proved proposal, however, a vector is extracted at 
a position located between white and black pixels 
and closer to the black pixel (i.e., a black pixel area 
10 is set to be smaller in width than a white pixel 
area), and outline smoothing is performed in accor- 
dance with this vector extraction. 

In the above case, although characters, line 
drawings, tables, graphic patterns, and the like can 
75 be processed to obtain good results, a deterioration 
in image quality may occur in pseudo-halftone im- 
ages formed by the dither method, the error diffu- 
sion method, and the like. 

More specifically, in the above case, attention 
20 is paid to each black pixel area in a white (back- 
ground) area in a binary image, and contour vec- 
tors are extracted at the boundaries between white 
pixel areas and black pixel areas. Processing is 
then performed in units of contour vector loops. For : 
25 this reason, removal of noise and smoothing are 
performed for even isolated points and black pixel 
coupled components constituted by several pixels 
coupled to each other in a scalelike form, which 
points and components are unique to a pseudo- 
30 halftone image. Therefore, an apparent density ob- 
tained by an area gradation expression of a pseu- 
do-halftone image may change, and a unique tex- 
ture is further emphasized, resulting in a deteriora- 
tion in image quality. 
35 In addition, in outline processing, an image is 

treated as vector data using coordinate values. For 
this reason, in processing an original image, such 
as a pseudo-halftone image, which is constituted 
by many isolated point and black pixel coupled 
40 components, each consisting of a small number of 
pixels, the vector data amount considerably in- 
creases as compared with the capacity of the origi- 
nal image data, or the processing time is extremely 
prolonged. 

45 The first embodiment of the present invention 

can solve the above problems. 

The first embodiment of the present invention 
will be described in detail below with reference to 
the accompanying drawings. 

50 Fig. 1 is a block diagram showing the arrange- 

ment of an apparatus of this embodiment. Refer- 
ring to Fig. 1, reference numeral 11 denotes a 
binary image acquiring unit for acquiring a digital 
binary image subjected to variable magnification 

55 processing, and outputting a binary image 17 of 
the raster scanning scheme; 12, an image area 
separating unit for separating the binary image data 
(signal) 17 of the raster scanning scheme from the 
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binary image acquiring unit 1 1 into pseudo-halftone 
component image data 18 and other component 
image data (to be referred to as character/line draw 
component image data hereinafter) 19; 13, an out- 
line variable magnification unit for extracting outline 
vectors from an input image, performing smooth- 
ing/variable magnification processing in the form of 
the extracted outline vector data, and reproducing, 
as binary image data of the raster scanning 
scheme, a binary image expressed by outline vec- 
tor data obtained by the smoothing/variable mag- 
nification processing, thereby obtaining a magnified 
image; 14, a pseudo-halftone image variable mag- 
nification unit which operates according to a 
scheme different from that for the outline variable 
magnification unit 13; 15, a synthesizing unit , for 
synthesizing an output 20 from the outline variable 
magnification unit 13 and an output 21 from the 
pseudo-halftone image variable magnification unit 
14 to generate a magnified image 22 with respect 
to the overall binary image data 17 of the raster 
scanning scheme; and 16, a binary image output 
unit for displaying the obtained magnified image, 
producing a hard copy, or outputting- the image 
data to a communication line or the. like. 

The binary image acquiring unit 1 1 is con- 
stituted by a known raster scanning type binary 
image output unit for reading an image by using, 
e.g., an image reader, and outputting binary image 
data according to the raster scanning scheme. 
Note that binary image acquiring unit 1 1 may be a 
unit for loading data from a storage medium in 
which binary image data is stored, or a unit for 
converting an image photographed by a still cam- 
era into a binary image as long as a binary image 
can be obtained. 

Fig. 2 shows the' arrangement of the image 
area separating unit 12. Referring to Fig. 2, refer- 
ence numeral 30 denotes a data holding unit for 
sequentially updating/holding each pixel value in 
each small area which is required for image sepa- 
ration processing. For example, the data holding 
unit 30 holds data corresponding to 8 x 8 pixels at 
maximum, i.e., 64 pixels around a target pixel, with 
respect to digital binary image data input according 
to the raster scanning scheme. The data holding 
unit 30 updates its contents in synchronism with an 
update operation with respect to the position of a 
target pixel (sequentially moved according to the 
raster scanning scheme). 

Fig. 7 shows an arrangement of the data hold- 
ing unit 30. Reference numeral 31 denotes a line 
buffer group, constituted by FIFOs, for holding data 
corresponding to seven rasters (scanning lines) im- 
mediately before the currently input raster; and. 32, 
a latch group for storing/holding a total of 64 data, 
eight-pixel data per raster. Referring to Fig. 2, 
reference numeral 40 denotes an image area deter- 



mining unit for determining, on the basis of the 
data of a pixel group including a target pixel and 
constituting a small area, which is output from the 
data holding unit 30, whether the target pixel in the 
s small area should be considered as a pixel in a 
pseudo-halftone area. The image area determining 
unit 40 is constituted by three types of determining 
sections, i.e., an isolated pixel determining unit 41, 
a periodicity determining unit 42, and a high-frer 
io quency component determining unit 43, for respec- 
tively determining whether different conditions are 
satisfied. If at least one of the above conditions is 
satisfied, it is determined that the target pixel is a 
pixel in the pseudo-halftone area. 
75 The isolated pixel determining unit 41 performs 

determination processing with respect to each of 
16 pixels in a 4 x 4 pixel area denoted by refer- 
ence numeral 322 in Fig. 3, i.e., a width of four 
pixels in the main scanning direction and a width of 
20 four pixels in the subscanning direction. More spe- 
cifically, as shown in Fig. 4, the isolated pixel 
determining unit 41 detects whether four pixels, 
. i.e., upper, lower, left, and right pixels (a position 

(k ; Jt-l)-is an upper position; a position (k,i +1), a 

25 lower position; a position (k-1,Jt), a left position; and 
a position (k + 1,1), a right position) are pixels of 
the same, color (Lie., white or black pixels), and also 
differ in color from a pixel at a position (k,l). If 
each pixel in a 4 x 4 pixel area is set at the 
30 position (k,Jt),. 16 results are obtained. If two or 
more results of these results satisfy the above 
condition, it is determined that a representative 
pixel 321 in the 4x4 pixel area 322 is in an 
isolated pixel area. That is, if the pixel 321 is a 
35 target pixel, it is checked whether two or more 
isolated pixels (i.e., an isolated pixel is a black, or 
white pixel isolated from other pixels in the vertical 
and horizontal directions) are present in the. 16 
pixels in the adjacent pixel area 322. If two or more 
40 isolated pixels are present, it is determined that the 
target pixel 321 is located within an isolated pixel 
area. In determining whether each of the 16 pixels 
in the adjacent pixel area 322 is an isolated pixel, 
the isolated pixel determining unit 41 refers to each 
45 pixel value of an area (enclosing the 4x4 pixel 
area 322) consisting of 32 pixels enclosed with a 
broken line 323. 

Assume that in determining an isolated pixel, 
the pixel value at a position (ij) is V(i,j), V(ij) = 1 
so indicates a black pixel, and V(i,j) = 0 indicates a 
white pixel. In this case, a determination result R- 
(k.l) can be obtained by a logic circuit for execut- 
ing the following logical expression: 

55 R(k,l) = (V(k,Z)*NOTV(k,l-1).NOTV(k-1,Jt)* 

NOTV(k,Jt +1).NOTV(k + 1,l)) + (NOTV(k,1). V- 
(M-l)*V(k- 

1,I)-V(k,I + 1)-V(k+1,I)) 
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In this expression, "•" indicates logical AND; 
" + ", logical OR; and "NOT", inversion (negation) 
of logical value. The order of priority of operations 
is "NOT" > ".">« + " (NOT is operated first). s 

Of the two terms of the right side of the above 
expression, the first term is operated to determine 
whether it is true that a target pixel is black and all 
adjacent pixels are not black pixels (i.e., all adja- 
cent pixels are white pixels). The second term is 10 
operated to determine whether it is true that a 
target pixel is white, and all adjacent pixels are not 
white pixels (i.e., all adjacent pixels are black pix- 
els). If one of the terms is true, the result (true = 
1) is returned to R(k,l). If it is determined that both 75 
the terms are false, the result (false = 0) is re- 
turned to R(k,£). 

In this manner, results "1" (indicating "true" 
determined by the above determination processing) 
of 16 results R(k,l) may be counted. In this case, 20 
16 results R(k,£) may be input according to an LUT 
(look-up table) scheme, and "1" may be output 
when two or more of the results indicate "1 ". 

The periodicity determining unit 42 determines 
whether four pixels (e.g., pixels A, B, C, and D 25 
indicated by hatching in Fig. 5), of 64 pixels in an 8 
x 8 pixel area 324 having a width of eight pixels in 
the main scanning direction and a width of eight 
pixels in the subscanning directions, which are 
separated from each- other by four pixels in the 30 
main scanning direction and/or separated from 
each other by four pixels in the subscanning direc- 
tion have the same pixel value. The periodicity 
determining unit 42 performs such determination 
processing except for a case wherein all the 64 35 
pixels are white or black pixels. 

In a 64 x 64 pixel area, 16 combinations of four 
pixels having a relative position relationship like the 
one between the pixels A, B, C, and D can be 
defined.* For example, a combination of pixels A', 40 
B\ C\ and D ! shown in Fig. 5 is one of such 
combinations. That is, when the pixel A can be set 
at 16 positions in an area enclosed with a broken 
line 325, the positions of the pixels B, C, and D can 
be set accordingly while each pixel is kept rela- 45 
tively separated from the pixel A by four pixels in 
the main scanning and subscanning directions. 
Therefore, a total of 16 combinations are set. In 
this embodiment, it is checked for each of these 16 
combinations whether the pixel values of four pix- so 
els are the same. It is also checked whether the 
above condition is satisfied in 14 or more combina- 
tions. If YES is obtained in this determination step, 
it is determined, except for a case wherein all the 
64 pixels are white or black pixels, that a periodic 55 
portion (i.e., a dither portion) is present. If the value 
of the pixel A is expressed as V(m,n), the values of 
the pixels B, C, and D can be expressed as V- 



(m + 4,n), V(m+4,n + 4), and V(m,n + 4), respective- 
ly. A determination result S(m,n) indicating whether 
all the four pixels A, B, C, and D have the same 
pixel value can be given by the following logical 
expression. The meaning of this logical expression 
is apparent from the above description. 

S(m,n) = V(m,n)* V(m + 4,n)- V(m + 4,n + 4)- V- 
(m,n + 4) 

+ NOT(V(m,n) + V(m + 4,n) + V(m + 4,n + 4) + V- 
(m,n + 4)) 

Of 16 results S(m,n) obtained in this manner, 
results indicating "1 " are counted to check whether 
the number of such results is 14 or more. It is also 
checked whether all the 64 pixels have the same 
pixel value (the logical AND of all the 64 input pixel 
values is "1" or the logical OR thereof is "0"). In 
this case as well, instead of counting results, 16 
results S(m,n) may be input by using an LUT, and 
"1" is output when 14 or more of the results 
indicate "1". 

Consider 36 pixels in a 6 x 6 pixel area (de- 
noted by reference numeral 326 in Fig. 6) having a 
width of six pixels in the main- scanning direction 
and a width of six scanning lines in the subscan- 
ning direction. In this case, there are a total of 60 
combinations of two pixels, i.e., 30 combinations 
(indicated by two-headed arrows in Fig. 6 in the 
horizontal direction) of two pixels adjacent to each 
other in the horizontal (main scanning) direction 
and 30 combinations (indicated by two-headed ar- 
rows in Fig. 6 in the vertical direction) of two pixels 
adjacent to each other in the vertical (subscanning) 
direction. The high-frequency component determin- 
ing unit 43 checks whether there are 28 or more 
combinations of two adjacent pixels, of the 60 
combinations, which have different pixel values. If 
there are 28 or more such combinations, the high- 
frequency component determining unit 43 deter- 
mines that the area 326 is a high-frequency com- 
ponent area. Whether two different pixels have 
different pixel values can be easily determined by 
calculating the exclusive OR of the pixel values of 
the two pixels. 60 results are totalized by using a 
counter or several LUTs (e.g., four LUTs, each for 
totalizing 15 results) and an adder, and whether a 
totalization result is 28 or more can be determined 
by using a comparator. Referring back to Fig. 2, 
reference numeral 44 denotes a three-input OR 
circuit 44 for receiving outputs from the isolated 
pixel determining unit 41, the periodicity determin- 
ing unit 42. and the high-frequency component 
determining unit 43 and outputting the logical OR 
of the outputs, as an output from the image area 
determining unit 40. That is, the OR circuit 44 (the 
image area determining unit 40) outputs a signal 
indicating that a target area is in a pseudo-halftone 
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area when it is determined that the target pixel is 
located in at least one of the following areas: an 
isolated pixel area, a periodic pixel area, and a 
high-frequency component area. 

A component image separating unit 50 re- 
ceives an output signal from the image area deter- 
mining unit 40 and a binary signal representing a 
target pixel, in the data holding unit 30, which is 
synchronized with the output signal (synchroniza- 
tion is established by a synchronization control 
circuit (not shown)), calculates/outputs the logical 
AND of the two inputs through an AND gate 51, 
and outputs the logical AND as the pseudo-halftone 
component image data 18. In addition, the logical 
NOT of the signal from the image area determining 
unit 40 is performed by a NOT circuit 52, and the 
logical AND of the resultant signal and the pixel 
value signal representing the target pixel is cal- 
culated by an AND gate 53 to be output as the 
character/line draw component image signal 19. 

That is, if it is determined that a target pixel is 
black and located in a pseudo-halftone area, the 
target pixel (black pixel) is recognized as a pseudo-. 
halftone component pixeL If it is determined that a 
target pixel is a black pixel and is not located in a 
pseudo-halftone area, the target pixel is recognized 
as a character/line draw component pixel. If a tar- 
get pixel is a white pixel, both the signals 18 and 
19 become n 0". 

The above description is associated with the 
arrangement of the image area separating unit 12 
and the contents of processing performed by the 
unit 12. Note that the threshold values respectively 
used by the" determining sections 41 to 43 in the 
image area separating unit 12 are not limited to 
those described above, but change in accordance 
with, e.g., the resolution of an input image and 
other states. 

The outline variable magnification unit 13 in 
Fig. 1 can be constituted by, e.g., a device dis- 
closed in Japanese Patent Application No. 3- 
345062 (filed by the assignee of the present ap- 
plication in December 26, 1991). As shown in Fig. 
10, the outline variable magnification unit 13. is 
constituted by an outline extracting unit 131, an 
outline smoothing/variable magnification unit 132, 
and a binary image reproducing unit 133. More 
specifically, in the outline variable magnification 
unit 13, the character/line draw component image 
signal 19 is received, and outline vectors (coarse 
contour vectors) are extracted from an image de- 
termined as a character/line draw component by 
the outline extracting unit 131. Outline vectors 
smoothly magnified at a desired (arbitrary) mag- 
nification in the state of the extracted outline vector 
expression are formed by the outline smooth- 
ing/variable magnification unit 132. A binary image 
is then reproduced from the smoothly magnified 



outline vectors by the binary image reproducing 
unit 133. With this processing, a high-quality char- 
acter/line draw component image magnified at a 
desired (arbitrary) magnification is formed. 
5 The pseudo-halftone variable magnification unit 

14 receives the pseudo-halftone component signal 
18, and magnifies an image, determined as a pseu- 
do-halftone component, at a desired magnification 
(equal to a magnification used by the outline vari- 

io able magnification unit), thereby generating a high- 
quality magnified pseudo-halftone image. 

Fig. 8 shows the details of the pseudo-halftone 
variable magnification unit 14. Reference numeral 
60 denotes ah inverse quantization processing unit 

75 for temporarily restoring a pseudo-halftone image 
as a binary image to a multivaiue image. As shown 
in Fig. 9, the inverse quantization processing unit 
60 refers to, e.g., 16 adjacent pixels around a 
target pixel 330 to calculate the sum total of the 

20 product of the 16 pixels and 16 corresponding 
coefficients, and obtains a multivaiue pixel value 
temporarily restored from the target pixel on the 
basis of the calculation result. . . . _ 
- When, for example, a binary pixel is to be ■■ 

25 converted into a multivaiue pixel value correspond- 
ing to eight bits (256 gradations), the input binary 
data (indicating "0" or "1") of 16 pixels may be 
multiplied by 256/16 (= 16) ("0" or "16" is ob- 
tained as a result), and the sum total of the 16 

30 products may be used as the multivaiue data of the 
target pixel. In this case, the multivaiue data of 

each target pixel takes a value, "0", "16", "32" 

As is apparent, a coefficient by which a binary pixel 
is multiplied may be weighted. 

35 In this inverse quantization processing, pro- 

cessing is performed while the target pixel position 
is sequentially moved in the raster scanning order, 
as in the processing performed by the image area 
separating unit. That is, multivaiue outputs obtained 

40 by inverse quantization are output in the raster 
scanning order. In addition, the sum total of the - 
products of 16 pixels around a target pixel and 16 
corresponding coefficients can also be obtained by 
counting black pixels in a 16-pixel area (in this 

45 case, the calculation result is reproduced in 17 
gradation levels from n 0" to "16". 

The output, i.e., the multivaiue pixel data, from 
the inverse quantization processing unit 60 is mag- 
nified at a desired magnification (equal to a mag- 
so nification used by the outline variable magnification 

unit) by an SPC variable magnification processing 

unit 70. SPC variable magnification processing is 
basically known variable magnification processing 
of repeatedly outputting the same input pixel value 

55 to enlarge an image or thinning the same input 
pixel value to reduce an image, the number of 
times corresponding to a desired magnification. For 
example, this processing is disclosed in Mat- 
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sumoto, Kobayashi, et a!., "Study on the Effect of 
the Resolution Conversion on Picture Quality", The 
Proceedings of the Institute of Image Electronics 
Engineers National Conference. No. 27, 1982). In 
an enlarging operation, pixels are interpolated. In 
this case, the density of a pixel (interpolation pixel) 
to be interpolated may be calculated by adding the 
pixel data of two pixels on both sides of the inter- 
polating position, and dividing the sum by two. 

A pseudo-halftone processing unit 80 binarizes 
the multivalue image data, which has undergone 
SPC variable magnification, again to obtain mag- 
nified binary image data. The pseudo-halftone pro- 
cessing unit 80 is constituted by, e.g., a known 
error diffusion processing circuit or a dither pro- 
cessing; circuit. These pseudo-halftone processes 
are disclosed in, for example, "Color Hard Copy 
Image Processing Technique", TRICEPS, WHITE 
SERIES, No. 114 (1990), pp. 33 - 48. 

The output (binary data) from the pseudo-hal- 
ftone processing unit 80 serves an output from the 
pseudo-halftone image variable magnification unit 
14. to a signal line 21. 

The binary image data obtained from a signal 
line 20 upon outline variable magnification process- 
ing and the binary image obtained from the signal 
line 21 upon different variable magnification pro- 
cessing are synthesized by the synthesizing unit 
15. 

Fig. 1 1 shows the arrangement of the syn- 
thesizing unit 15. Referring to Fig. 11, reference 
numeral 151 denotes an image data buffer for 
image data which has undergone outline variable 
magnification processing. The image data buffer 
151 serves to hold binary image data obtained 
from the outline variable magnification unit 13 via 
the signal line 20 upon outline variable magnifica- 
tion processing. Reference numeral 152 denotes an 
image data buffer for image data which has under- 
gone pseudo-halftone variable magnification pro- 
cessing/ The image data buffer 152 serves to hold 
the binary image obtained from the pseudo-hal- 
ftone image variable magnification unit 14 via the 
signal line 21 upon variable magnification process- 
ing. Reference numeral 153 denotes a synthesized 
image data buffer for temporarily holding image 
data obtained by synthesizing image data from the 
image data buffers 151 and 152; 154, a synchro- 
nization control circuit for performing synchroniza- 
tion control according to ' the raster scanning 
scheme to synchronously read out image data ob- 
tained by outline variable magnification processing 
and stored in the buffer 151 and image stored in 
the buffer 152. The magnified binary image data 
read out from the buffers 151 and 152 by trie 
control of the synchronization control circuit 154 
according to the raster scanning scheme are logi- 
cally ORed by an OR circuit 155 for each pair of 
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corresponding pixels. As a result, the binary image 
data are synthesized and temporarily stored in the 
image data buffer 153 according to the raster scan- 
ning scheme. 

5 The binary image output unit 16 is constituted 

by a hard copy apparatus such as a laser beam 
printer or a thermal printer for receiving image 
data, obtained by variable magnification processing 
and stored in the image data buffer 153 in the 

10 synthesizing unit 15, via a signal line 22. The 
binary image output unit 16 records binary image 
data on a paper sheet and outputs it as a hard 
copy. 

75 (Second Embodiment) 

The binary image acquiring unit 11 in the 
above embodiment (first embodiment) need not be 
an image reader but may be a binary image receiv- 

20 ing unit such as the receiving unit of a facsimile 
apparatus, which receives a binary image from an 
external unit by using a communication unit. The 
binary image output unit 16 in the above embodi- 
ment heed not be a hard copy unit but may be a 

25 binary image transmitting- unit, such as the trans- 
mitting unit of a facsimile apparatus, which outputs 
a binary image (as coded data) to an external unit 
by using a communication unit. The binary image 
output unit 16 may be an interface unit for output- 

30 ting binary image data to an external storage unit 
such as a magnetic disc, a display unit such as a 
display, or the like. 

In addition, the binary image acquiring unit 
may be an interface unit for receiving binary image 

35 data from an external storage unit such as a mag- 
netic disc or ah optical disc. 

(Third Embodiment) 

40 The present invention can be realized by an 

arrangement shown in Fig. 12 in place of the 
arrangement of the first embodiment. That is, the 
output 17 from the binary image acquiring unit 11 
may be directly input to the pseudo-halftone image 

45 variable magnification unit 14 in the first embodi- 
ment, instead of the output 18 from the image area 
separating unit 12. The effect obtained by this 
arrangement may be inferior to the effect obtained 
in the first embodiment. If, however, there are mer- 

50 its in terms of cost and processing speed depend- 
ing on device design, the relationship in arrange- 
ment with other components, the manner of arrang- 
ing other variable magnification unit, and the like, 
this arrangement may be employed. 

55 
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(Fourth Embodiment) 

The present invention can be realized by an 
arrangement shown in Fig. 13 in place of the 
arrangement of the first embodiment. That is, the 
output 17 from the binary image acquiring unit 11 
may be directly input to the outline variable mag- 
nification unit 13 in the first embodiment, instead of 
the output 19 from the image area separating unit 
12. Other operations are the same as those in the 
first embodiment The effect obtained in this ar- 
rangement may be slightly inferior to the effect 
obtained in the first embodiment. If, however, there 
are merits in terms of cost and processing speed 
depending on device design, the relationship in 
arrangement with other components, the manner of 
arranging other variable magnification unit, and the 
like, this arrangement may be employed. 

(FiftK Embodiment) 

The pseudo-halftone processing unit 80 con- 
stituting the pseudo-halftone image variable mag- 
nification unit 14 of the above-described embodi- 
ments may use a mean density retention method 
(MD method) described in NIKKEI ELECTRONICS, 
1992. 5. 25 Issue (No. 555), pp. 207 - 210. 

(Sixth Embodiment) 

The pseudo-halftone image variable magnifica- 
tion unit 14 may simply magnify the pseudo-hal- 
ftone component image 18, as binary image data, 
by SPC processing without temporarily converting 
the image 18 into a multivalue image by inverse 
quantization, and outputs, as the output 21, the 
binary image data obtained by the SPC variable 
magnification processing. 

In this case, the corresponding portion is sim- 
plified so that fairly good image quality can be 
realized at a low cost. 

(Seventh Embodiment) 

The coefficient matrix in the inverse quantiza- 
tion processing unit in the pseudo-halftone image 
variable magnification unit 14 in each of the first to 
fifth embodiments is not limited to a size of 4 X 4 
pixels like the one described with reference to Fig. 
9. For example, the coefficient matrix may have a 
size of 8 x 8 or 5 x 5 pixels, as shown in Fig. 25, or 
may have a general size of m x n (m and n are 
integers) pixels such as a size of 6 x 4 pixels. In 
addition, all the coefficients need not be "1 but 
may have different values. For example, as shown 
in Fig. 26, coefficients corresponding to pixels clos- 
er to a target pixel may have larger values. If the 
size of a coefficient matrix is set in accordance 



with the number of gradation levels of the pseudo- 
halftone expression of an original image, reproduc- 
tion of a more faithful multivalue image can be 
expected. However, such an operation leads to an 

5 increase in cost. Therefore, it is preferable that the 
size of a coefficient matrix be properly selected. 

The present invention may be applied to a 
system constituted by a plurality of devices or an 
apparatus constituted by one device. As is appar- 

10 ent, the present invention can be applied to a case 
wherein the above-described effects can be ob- 
tained by supplying programs to a system or an 
apparatus. 

It is apparent, therefore, the present invention 
75 can be constituted by, e.g., a scanner unit for 
reading an original image, a host computer for 
processing the read, image data, and a printer for 
forming an output image. 

Variable magnification processing in each em- 

20 bodiment described above is performed for pro- 
cessing (resolution conversion processing) of 
equalizing the sizes of images having different res- 
olutions, as in the case wherein an image input by 
the binary image acquiring unit 11 is different in 

25 resolution from an output from the binary image 
output unit 16, in addition to enlargement and re- 
duction of images. 

As described above, according to the first as- 
pect of the present invention, when an image is to 

30 be magnified and output, a high-quality image can 
be obtained as a result of variable magnification 
processing by performing proper variable magnifi- 
cation processing with respect to a character/line 
draw component and a pseudo-halftone compo- 

35 nent, respectively. 

In addition, each image area is variably mag- 
nified by two independent variable magnification 
processes instead of one variable magnification 
processing, and at least some portion of an image 

40 can be variably magnified by one variable mag- 
nification process demanding low memory con- 
sumption in place of the other variable magnifica- 
tion process demanding high memory consump- 
tion. Therefore, the overall memory consumption 

45 can be suppressed low. 

(Eighth Embodiment) 

Fig. 27 is a block diagram showing the func- 
so tional arrangement of a high-image-quality resolu- 
tion conversion apparatus using an outline smooth- 
ing method according to the eighth embodiment of 
the present invention. 

Referring to Fig. 27, reference numeral 2100 
55 denotes an image input unit for receiving binary 
image data in the form of a bit map according to 
the raster scanning scheme, and outputs the data 
to an outline extracting unit on the next stage. For 
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example, the image input unit 2100 is realized by 
an image reader for reading an original image by a 
scanner, binarizing the readjmage, and outputting 
the binary data according to the raster scanning 
scheme, or an image decoding unit for demodulat- 5 
ing coded image data received in an image com- 
munication unit via communication line and decod- 
ing the data into image data in the form of a bit 
map. Reference numeral 2107 denotes an image 
output unit for outputting a binary image obtained 10 
upon completion of high-image-quality resolution 
conversion: This image output unit is realized by a 
known laser beam sprinter, an image output unit 
(printer unit) for printing out an image received in 
an image processing communication unit, or the 75 
like. 

Reference numeral 2101 denotes an outline 
extracting unit for extracting contour vectors along 
the contour of a black image (in a case wherein a 
binary image is constituted by a white or black 20 
image) of the binary image data input from the 
image input unit 2100. Extraction of contour vectors 
is performed in the same manner as described 
above, and hence a description thereof will be 
■omitted. - 25 

In the image processing apparatus of the 
eighth embodiment, since isolated points, fine 
curves, or the like are detected by a contour vector 
counter 2104 (to be described later), isolated 
points, fine curves, or the like need not be 30 
smoothed in the first smoothing processing, (first 
smoothing unit 2102). 

Referring back to Fig. 27, reference numeral 
2103 denotes a variable magnification unit for mag- 
nifying an output image from the first smoothing 35 
unit 2102 after the first smoothing processing at an 
arbitrary magnification. In this variable magnifica- 
tion processing, if contour vector data after the first, 
smoothing processing are given as coordinate data, 
each coordinate data may be magnified at a de- 40 
sired magnification. 

The contour vector counter 2104 counts con- 
tour vectors per vector loop. A large portion of a 
pseudo-halftone image is constituted by discontinu- 
ous images such as isolated points and fine 45 
curves. In contrast to this; in a character/line draw 
image, image areas constituted by black pixels are 
relatively continuous. That is, in a pseudo-halftone 
image, the number of contour vectors constituting 
one vector loop is relatively small, whereas in a. so 
character/line draw image, the number of contour 
vectors constituting one vector loop is iarge. 

If isolated points and fine curves of a pseudo- 
halftone portion are subjected to smoothing pro- 
cessing, the density value of the, pseudo-halftone 55 
portion changes, resulting in a deterioration in im- 
age quality after resolution conversion. This phe- 
nomenon becomes conspicuous especially in the 



second smoothing processing described above. 
For this reason, the contour vector counter 2104 
counts contour vectors constituting one vector loop, 
and determines whether to perform the second 
smoothing processing in accordance with the num- 
ber of vectors. 

The number of vectors as a reference must be 
set to be relatively small. This is because isolated 
points and fine curves constituting a pseudo-hal- 
ftone image are constituted by a contour vector 
loop consisting of a relatively small number of 
contour vectors. In this embodiment, the reference 
number is set to be about 32. However, the refer- 
ence number is not specifically limited and may be 
changed in accordance with the type of an image. 
If the number of contour vectors counted is smaller 
than a reference value, the contour vector counter 
2104 determines that the contour vector loop is 
constituted by isolated points, fine curves, or the 
like constituting a pseudo-halftone image. Conse- 
quently, the second smoothing. .processing is not 
performed. In contrast to this, if the number of 
contour vectors counted is larger than the refer- 
ence value, the contour vector counter 2104 deter- 
mines that the contour vector loop is an image area 
other than an area consisting of isolate points, fine 
curves, or the like. As a result, the second smooth- 
ing processing is performed by a second smooth- 
ing unit 2105. 

The first smoothing processing performed by 
the first smoothing unit 2102 described above is 
smoothing processing by unit of pattern matching. 
In contrast to this, in the second smoothing pro- 
cessing performed by the second smoothing unit 
2105, * weighted mean processing of the coordi- 
nated data of a target contour vector and the co- 
ordinate data of contour vectors before and after 
the target contour vector is performed to smooth 
an image. This second smoothing processing is 
performed in units of contour vector loops, as de- 
scribed above. 

Fig. 24 is a view for explaining weighted mean 
processing in the second smoothing processing. 
Referring to Fig. 24, marks @ (contour vector 
coordinates P0 and P4) are contour vector coordi- 
nates designated as corner points for which the 
second smoothing processing is not performed. In . 
this case, if the end portion of a corner portion in 
an image is subjected to the second smoothing 
processing, the sharpness of the image may be 
lost. A corner point is designated in the pattern 
matching process in the first smoothing processing 
described above to prevent the second smoothing 
processing from being performed with respect to 
such a portion. Other contour vector coordinates 
P1, P2, and P3 indicate contour vector coordinates 
to be subjected to the second smoothing process- 
ing. 
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When weight mean processing is performed in 
the second smoothing processing, uneven portions 
between the contour vector coordinates designated 
as the corner points are eliminated to obtain a 
smoothing effect (as if the respective contour vec- 
tor coordinates were connected to each other via a 
string, and the string was pulled from both the 
sides thereof). That is, the contour vector coordi- 
nates P1, P2, and P3 respectively move to Q1, Q2, 
and Q3. Therefore, in the second smoothing pro- 
cessing, especially the spaces between fine curves 
expressing a pseudo-halftone portion may be nar- 
rowed or expanded. As a result, if resolution con- 
version is performed by an outline smoothing 
method, the density of an image as a pseudo- 
halftone portion may not be maintained. The con- 
tour vector counter 2104 prevents the second 
smoothing processing from being performed with 
respect to isolated points, fine curves, or the like 
expressing a pseudo-halftone image, thereby pre- 
venting a change" in density of a pseudo-halftone 
portion. 

As described above, the contour vector counter 
. 2104 in Fig.. 27. counts contour vectors constituting 
one contour vector loop. If this count value is larger 
than a reference value, the second smoothing pro- 
cessing is performed. Otherwise, the following bi- 
nary image reproduction is performed without per- 
forming the second smoothing processing. 

Reference numeral 2106 denotes a binary im- 
age reproducing unit for reproducing a binary im- 
age from contour coordinate data. As described 
above, contour vector data after variable magnifica- 
tion/smoothing processing is just a boundary in- 
dicating a contour portion, of an image, assumed 
between white pixels and black pixels, but does not 
form a binary image without any modification. 
Therefore, the process of reproducing a binary 
image by painting the inside of a vector loop con- 
stituted by contour vectors in black (replacing white 
pixels with black pixels) is required. 

Fig. 32 is a view for explaining binary image 
reproduction processing performed by the binary 
image reproducing unit 2106. 

Referring to Fig. 32, reference symbols A to M 
denote contour vector coordinates. There are a 
total of 12 contour vectors, which constitute one 
contour vector loop. There are two methods of 
painting the inside of this contour vector loop: a 
method of defining boundary points (contour points 
defined on contour vectors and located on bound- 
aries between images) on vectors while performing 
raster scanning, and determining/defining a white 
or black pixel every time a boundary point appears; 
and a method of defining all boundary points on a 
contour vector loop in advance, and replacing the 
inside of an area enclosed with the boundary points 
with black pixels at once. Either method can ba- 



sically reproduce a binary image, but may not 
properly reproduce a binary image on the basis of 
contour vector coordinate points and the like lo- 
cated on horizontal vectors or end points of an 
5 image. 

More specifically, if boundary points are de- 
fined on horizontal vectors, and a binary image is 
reproduced while raster-scanning the boundary 
points, black and white pixels are alternately pro- 
10 duced. As a result, an image like an image con- 
stituted by dotted lines is reproduced. On the other 
hand, since only one boundary point is defined with 
respect to an . end point of an image, a black 
horizontal line may be reproduced. For this reason, 
75 the binary image reproducing unit 2106 in the 
eighth embodiment employs a method of properly 
performing binary image reproduction with respect 
to a special case (horizontal vectors and end points 
of an image) by pattern matching in addition to the 
20 above-described technique. More specifically, a 
horizontal vector or an end point is detected by 
vector pattern, matching, and an exceptional case is 
applied to only this detected portion. In an. excep- 

tional- case of- a horizontal vector, boundary points 

25 are defined at only the start and end points of the 
vector. With regard to an end point, two boundary 
points are continuously defined. 

The above description is associated with the 
processing unit and process of the high-image- 
30 quality resolution conversion method using the out- 
line smoothing method. 

According to this method, in the contour vector 
counter 2104, the number of contour vectors con- 
stituting one contour vector loop is not specifically 
35 limited, but . can be arbitrarily set in advance in 
accordance with the type of an image, thereby 
allowing, high-image-quality resolution conversion 
with respect to various types of pseudo-halftone 
images (e.g., dither images and images obtained 
40 by the error diffusion method). 

By using another known area determining 
method in addition to the above method, an image 
in a pseudo-halftone area and an image in a char- 
acter/line draw area can be more reliably discrimi- 
45 nated, and high-image-quality resolution conver- 
sion, which is the object of this embodiment, can 
be more properly performed. 

The high-image-quality resolution conversion 
_ method -using the outline smoothing method of this 
so embodiment can be used for any image processing 
apparatus which performs resolution conversion. 
The ninth embodiment described next is asso- 
ciated with an image processing apparatus using 
the method of the eighth embodiment. 

55 
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<Ninth Embodiment) 

A high-image-quality resolution conversion 
method using an outline smoothing method accord- 
ing to the ninth embodiment can be applied to a 
case wherein an image having a specific low reso- 
lution, which is received in an image processing 
communication apparatus such as a facsimile ap- 
paratus, is converted into image data having a high 
resolution by resolution conversion in accordance 
with a printer to be printed out. 

Fig-. 33 is a block diagram showing the ar- 
rangement of an image processing communication 
apparatus to which the resolution conversion meth- 
od using the outline smoothing method according 
to the ninth embodiment is applied. 

Referring to Fig. 33, reference numeral 2130 
denotes a scanner. The resolution of the scanner 

2130 is not set to be very high but is set to be, 
e.g., about 200 dpi at most to minimize the trans- 
mission time of a read image. Reference numeral 

2131 denotes an image processing unit for per- 
forming various kinds of image processing, e.g., 
ABC correction, shading correction, bright- 

. ness/density conversion processing, and binariza- 
tion processing. ABC correction is performed to 
correct a change in intensity of a read signal with a 
deterioration in a light source over years. Shading 
correction is performed to equalize the intensities 
of signals read at the central and end portions of 
the read portion of- the scanner 2130. Bright- 
ness/density conversion is performed to convert 
read image data as brightness data into density 
data to be printed out. Binarization processing is 
performed to convert a read signal having a grada- 
tion level into image data having one (white or 
black) of the two gradation levels. As a method of 
performing this binarization processing, a known 
error diffusion method or dither method is avail- 
able. 

Reference numeral 2132 denotes an encod- 
ing/decoding unit for compressing/expanding image 
information; 2133, a memory for temporarily storing 
image data . received via a MODEM 2137; and 
2134, a resolution converter having, for example, 
the arrangement shown in Fig. 27 or 34 (from 
which the image input unit 2100 and the image 
output unit 2107 are omitted). The resolution con- 
verter 2134 performs resolution conversion by us- 
ing the' outline/smoothing method. Since the re- 
cording density in a printer 2135 is generally high- 
er than the reading density in the scanner 21 30, 
resolution conversion of an image must be per- 
formed immediately before it is output from the 
printer 2135. As the printer 2135, a printer having a 
higher resolution than a scanner is generally used 
to output a beautiful image. In this case, the resolu- 
tion of the printer 2135 is set to be 400 or 600 dpi. 



Reference numeral 2136 denotes an NCU (Net- 
work Control Unit) for controlling connection to a 
communication line. Most facsimile apparatuses not 
only print out read image by themselves but also 

5 receive an image from a communication line to 
print out it. The NCU 136 serves to perform match- 
ing between this communication line and the fac- 
simile apparatus at the time of connection. The 
MODEM 2137 modulates/demodulates image data 

to to allow transmission/reception thereof via a com- 
munication line. 

In the above arrangement, all the components 
other than the resolution converter 134 using the 
outline smoothing method are known portions in, 

75 e.g., a facsimile apparatus. 

As described above, the resolution of a read 
image is often different from the resolution of the 
printer 2135 in a case wherein an original image is 
to be read by the scanner 2130 and is to be 

20 directly output to the printer 2135, or a case 
wherein the NCU 2136 is to output a received 
image to the printer 2135. Assume that a G3 fac- 
simile apparatus is used. In this case, when the 
resolution. of the printer 2135 is 400 dpi, the resolu- 

25 tion of image data must be converted at a mag- 
nification of 2 x 4 (main scanning x subscanning) in 
a standard mode, or at a magnification of 2 x 2 in a 
fine mode. When the resolution of the printer 2135 
is 600 dpi, the resolution of image data must be 

30 converted at a magnification of 3 x 6 in the stan- 
dard mode, or at a magnification of 3 x 3 in the fine 
mode. 

In the conventional facsimile apparatus as well, 
a known resolution conversion method is used. In 

35 the ninth embodiment, however, a resolution con- 
version method using the outline smoothing meth- 
od is used in place of the conventional resolution 
conversion method. With this method, resolution 
conversion can be realized while high image qual- 

40 ity is maintained, which cannot be realized by the 
conventional method. In addition, in a facsimile 
apparatus, a photographic image or the like as a 
pseudo-halftone expression is sometimes received. 
By applying the resolution conversion method us- 

45 ing the outline smoothing method according to the 
embodiment to such a case, resolution conversion 
with high image quality can be performed with 
respect to a pseudo-halftone image. 

so (Tenth Embodiment) 

In addition to the arrangement of the embodi- 
ment shown in Fig. 27, the arrangement of an 
image processing apparatus which can realize 
55 high-image-qualrty resolution conversion by using 
the outline smoothing -method is shown in Fig. 34. 
The same reference numerals in Fig. 34 denote the 
same parts as in Fig. 27, and a description thereof 

16 
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will be omitted. 

In the eighth embodiment, extracted contour 
vector coordinate data which has undergone outline 
smoothing is smoothed by the first smoothing unit 
2102, and the second smoothing processing is 5 
selectively performed depending on the number of 
contour vectors. In the tenth embodiment, a first 
smoothing unit, a variable magnification unit, and a 
second variable magnification unit are systemati- 
cally selected in accordance with the number of 10 
contour vectors constituting one contour vector 
loop. 

As described above, isolated points, fine 
curves, and the like constituting a pseudo-halftone 
image are used for a pseudo-expression of the is 
density of the pseudo-halftone image. Preferably, 
these elements are not be removed or smoothed. 
In the eighth embodiment, the first smoothing unit 
2102 performs smoothing of pattern images other 
than isolated point removal patterns or smoothing 20 
patterns such as fine curves. In the tenth embodi- 
ment, however, any limitations need not be im- 
posed on smoothing patterns because a contour 
vector counter .2104 is .used, before, the. first - - - 
smoothing unit. 25 

Referring to Fig. 34, the contour vector counter 
2104 receives contour vector data extracted by an 
outline, extracting unit 2101. When the image data 
is input to the contour vector counter 2104, the first 
smoothing processing has not been performed by 30 
the first smoothing unit 2102. 

The contour vector counter 2104 counts con- 
tour vectors constituting each contour vector loop, 
and classifies vector loops, into vector loops to be 
subjected to smoothing/variable magnification pro- 35 
cessing and vector loops to be simply magnified. 
More specifically, when the number of contour vec- 
tors constituting a vector loop is small, the contour 
vector counter 2104 directly outputs the contour 
vector data to a variable magnification unit 21 1 0 so 40 
as to perform variable magnification processing of 
the data. When the number of contour vectors 
constituting a vector loop is large, the contour 
vector counter 2104 outputs the contour vector 
data to the first smoothing unit 21 02 to execute the as 
above-described processing through a variable 
magnification unit 2111 and a second smoothing 
unit 2105. 

When one of the procedures for processing is 
selected by the contour vector counter 2104, each 50 
portion of the above-described embodiment is ap- 
plied. Note that the first smoothing unit 2102 need 
not omit isolated point removal patterns and 
smoothing patterns such as fine curves, unlike in 
the eighth embodiment The variable magnification 55 
unit 2111 uses the method of performing resolution 
conversion by multiplying contour vector coordi- 
nate data by a magnification as in the eighth em- 



bodiment. 

The variable magnification unit 2110 serves to 
perform variable magnification processing of iso- 
lated points, fine curves, and the like constituting a 
pseudo-halftone portion, and may use the method 
of performing resolution conversion by multiplying 
contour vector coordinate data by a magnification. 
However, the variable magnification unit 2110 pref- 
erably magnifies the data while maintaining the 
density of the pseudo-halftone portion by using 
some density maintaining/variable magnification 
processing. 

The. tenth embodiment has been described 
above. The tenth embodiment can also prevent the 
second smoothing processing from being per- 
formed with respect to isolated points, fine curves, 
and the like constituting a pseudo-halftone portion. 
Therefore,, the same effects as those of the eighth 
embodiment can be obtained. 

The present invention may be applied to a 
system constituted by a plurality of devices or an 
apparatus constituted by one device. As is appar- 
ent, the present invention can be applied to a case, 
^wherein- the above-described effects can- be- ob- 
tained by supplying programs to a system or an 
apparatus. 

The eighth to tenth embodiments have been 
independently described above. However, these . 
embodiments may be singly executed, or the con- 
stituent elements of the embodiments may be 
properly combined with each other. 

As has been described above, according to 
this embodiment, in performing outline smoothing 
processing, smoothing processing is not performed 
with respect to isolated pixels, fine curves, and the 
like constituting a pseudo-halftone portion, while 
smoothing processing is performed with respect to 
a character/line draw image exhibiting a large num- 
ber of contour vectors constituting each contour 
vector loop in the same manner as in the prior art, 
thereby realizing high-image-quality resolution con- 
version. 

Resolution conversion; therefore, can be per- 
formed while the density value of a pseudo-hal- 
ftone portion expressing pseudo-halftone is main- 
tained. Hence, the high-image-quality resolution 
conversion method using the outline smoothing 
method can be applied to a pseudo-halftone image 
as well. 

By applying the outline smoothing processing 
according to this embodiment to a facsimile ap- 
paratus, even a received or read pseudo-halftone 
image can be output to a high-resolution printer to 
print a high-quality image. 

As described above, according to the present 
invention, the halftone density of image data can 
be maintained even after smoothing processing or 
resolution conversion. 
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In addition, according to the present invention, 
since resolution conversion is performed while no 
smoothing processing is performed with respect to 
isolated pixels and corner portions, the density of 
the image data upon resolution conversion can be 5 
maintained. 

(Eleventh Embodiment) 

Fig. 35 is a block diagram showing the ar- io 
rangement of an image processing apparatus ac- 
cording to the eleventh embodiment of the present 
invention. 

Referring to Fig. 35, reference numeral 3001 
denotes a binary image acquiring unit for acquiring 75 
a digital binary image to be subjected to variable 
magnification processing, and oufputting a binary 
image according to the raster scanning scheme; 
3002, an image area determining unit for determin- 
ing an image area including pseudo-halftone por- 20 
tions or an image area including other components 
(to be referred to as character/line draw compo- 
nents hereinafter) with respect to each pixel of the 
binary image data (signal) output from the binary 
. . image acquiring .unit. 300.1 ..according to the raster 25 
scanning scheme; 3003, an image area determina- 
tion result variable magnification unit for variably 
magnifying area information output from the image 
area determining unit 3002; 3004, an outline extrac- 
tion image forming unit for forming binary image 30 
information consisting of a character/line draw com- 
ponent and black pixels adjacent thereto of the 
binary image data, output from the binary image 
acquiring unit 3001 according to the raster scan- 
ning scheme, in accordance with the image area 35 
determined by the image area determining unit 
3002; and 3005, an outline variable magnification 
unit for receiving the binary image data output from 
the outline extraction image forming unit 3004 ac- 
cording to the raster scanning scheme, and extract- 40 
ing outline Vectors from the input image informa- 
tion. In addition, smoothing and variable magnifica- 
tion processing of the image in the form of the 
extracted outline vector data are performed, and a 
binary image expressed ' by the 45 
smoothed/magnified outline data is reproduced as 
binary image data according to the raster scanning 
scheme from the outline data, thereby obtaining a 
magnified image. 

Reference numeral 3006 denotes a pseudo- so 
halftone variable magnification unit for receiving the 
binary image data from the binary image acquiring 
unit 3001 according to the raster scanning scheme, 
and variably magnifying the data by a scheme 
different frorn that used by the outline variable 55 
magnification unit 3005; 3007, a select- 
ing/synthesizing unit for receiving an output 3016 
from the outline variable magnification unit 3005 



and an output 3017 from the pseudo-halftone vari- 
able magnification unit 3006, and selecting one* of 
the outputs 3016 and 3017 in accordance with an 
image area determination result 3014 from the im- 
age area determination result variable magnification 
unit 3003, thereby obtaining a magnified synthe- 
sized image; and 3008, a binary image output unit 
for displaying the magnified image obtained by the 
selecting/synthesizing unit 3007, producing a hard 
copy of the data, or outputting the data to a com- 
munication line. 

The arrangements and operations of the re- 
spective units will be sequentially described below. 

The binary image acquiring unit 3001 is a 
binary image output unit or the like for reading 1 an 
image by, e.g., an image reader, and binarizing 
and outputting the read image according to the 
raster scanning scheme. The binary image acquir- 
ing unit 3001 may be an apparatus for loading data 
from a storage medium in which a binary image is 
stored, or an apparatus for converting an image 
photographed by a still camera into a binary image. 

Fig. 36 shows an arrangement of the image 
area determining unit 3002. 

Referring, to Fig. 36, reference numeral -3021.. 
denotes a data holding unit for sequentially updat- 
ing and holding each pixel value in a small area 
. required for image area determination processing. 
The data holding unit 3021 holds a data group 324 
consisting of a maximum of 8 x 8 = 64 pixels 
around a target pixel 321, as shown in, e.g., Fig. 5, 
with respect to digital image data input according 
to the raster scanning scheme. In synchronism with 
updating of the target pixel position (sequentially 
moved according to the raster scanning scheme), 
the data' holding unit 3021 updates the contents of 
the data held to data of a corresponding area. 

The arrangement of the data holding unit 3021 
is the same as that shown in Fig. 7, and hence a 
description thereof will be omitted. 

Referring back to Fig. 2, reference numeral 
3022 denotes an image area determination con- 
dition unit for determining, on the basis of the data 
of a pixel group constituting a small area and 
including a target pixel, which data is output from 
the data holding unit 3021 , whether the target pixel 
in the small area is a pixel in a pseudo-halftone 
area. The image area determination condition unit 
3022 is constituted by four types of determining 
units, i.e., an isolated pixel determining unit 3026, 
an isolated pixel area determining unit 3027, a 
periodicity determining unit 3028, and a high-fre- 
quency component determining unit 3029 for re- 
spectively determining whether different conditions 
are satisfied. If at least one of these conditions is 
satisfied, it is determined that the target pixel is a 
pixel of a pseudo-halftone component. 
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The isolated pixel determining unit 3026 deter- 
mines whether a target pixel is an isolated pixel. 

Fig. 37 shows a pixel matrix 3204 of a 3 x 3 
pixel area having a width of three pixels in the main 
scanning direction and a width of three pixels in the 5 
subscanning direction, with a target pixel 3201 in 
the center of the matrix. When all the pixels in this 
matrix except for the target pixel 3201 have the 
same pixel value (all are white or black pixels), and 
the pixel value of the target pixel is different from 10 
that of the adjacent pixels, it is determined that the 
target pixel 3201 is an isolated pixel. 

Assume that V(i,j) represents the pixel value 
corresponding to the ith row and the jth column, V- 
(i.j) = 1 indicates a black pixel, and V(i,j) = 0 75 
indicates a white pixel. In this case, a determination 
result R(i,j) obtained by the isolated pixel determin- 
ing unit 3026 can be realized by a logic circuit for 
executing the following logical expression: 

20 

Rd.J) = (V(r.j).NOT(V(i-1,j-1)).NOT(V(i-1,j)). 
NOT<V(,-t.j+ 1)).NOT(V(iJ-1)). NOT(V(ij + 1))- 

•N.O.T.(V<l* J.j- - 

1 )) - NOI i V(i + 1 ,j)). NOT(V(i -+ 1 ;j + 1 )))) 

+ (NOI{V(..j)).V(i-1j-1)).V(i-1 j). V(i-1J + 1).V(i,j- 25 

1)*v< t .-*i). V(i + lj-1).V(i + 1J).V(i + 1j + 1)) 

In this ipgical expression, indicates logical. 
AND: logical OR; and "NOT(x)", inversion of 
a logical value x. The order of priority of operations 30 
is "NOT(k)" > > " + This embodiment is 
different from the first embodiment in that pixels 
located in oblique directions with respect to a tar- 
get pixel are also taken into consideration. 

The isolated pixel area determining unit 3027 35 
determines whether a target pixel is located in an 
isolated pixel area. Fig. 3 shows a detailed exam- 
ple of the determining operation. Referring to Fig. 
3. a pixel matrix 322 is constituted by 16 pixels in a 
4x4 pixel area having a width of four pixels in the 40 
main scanning direction and a width, of four pixels 
in the subscanning direction. 

As shown in Fig. 4, with respect to each pixel 
in this pixel matrix 322, the isolated pixel area 
determining unit 3027 detects whether four pixels, " 45 
i.e., upper, lower, left, and right pixels (a position 
(k,L-1) is an upper position; a position (k,L+1), a 
tower position; a position (k-1 ,L), a left position; and 
a position (k+-1,L), a right position) are pixels hav- 
ing the same pixel value (i.e., white or black pix- 50 
els), and also differ in pixel value from a pixel at a 
position (k.L). If each pixel in a 4 x 4 pixel area is 
set at the position (k,L), 16 results are obtained. If 
two or more results of these results satisfy the 
above condition, it is determined that the target 55 
pixel 321 in the 4x4 pixel area 322 is in an 
isolated pixel area. That is, if the pixel 321 is a 
target pixel, it is checked whether two or more 



isolated pixels (i.e., an isolated pixel is a black or 
white pixel isolated from other pixels in the vertical 
and horizontal directions) are present in the 16 
pixels in the adjacent pixel area 322. If two or more 
isolated pixels are present, it is determined that the 
target pixel 322 is located within an isolated pixel 
area. 

The periodicity determining unit 3028 deter- 
mines whether pixel values become the same at a 
predetermined pixel period. The arrangement of 
the periodicity determining unit 3028 is the same 
as that of the periodicity determining unit 42 in the 
first embodiment. 

The high-frequency component determining 
unit 3029 determines whether a change in density 
occurs between adjacent pixels. The arrangement 
of the high-frequency component determining unit 
3029 is also the same as that of the high-frequency 
component determining unit 43 in the first embodi- 
ment, and hence a description thereof will be omit- 
ted. 

Referring to Fig. 36, reference numeral 3023 
-denotes a four-input OR circuit -for receiving . out- 
- puts from the isolated pixel determining unit 3026, 
the isolated pixel area determining unit 3027, the 
periodicity determining unit 3028, and the high- 
frequency component determining unit 3029, and 
outputting the logical OR of the outputs. This logi- 
cal OR is an output from the image area determin- 
ing unit 3002. That is, the OR circuit 3023 outputs 
a signal indicating that a target pixel is in a pseu-. 
do-halftone area when it is determined that the 
target pixel is located in at least one of the follow- 
ing areas: an isolated pixel area, a periodic pixel 
area, and a high-frequency component area. . 

The above description is associated with the 
arrangement and processing contents of the image 
area determining unit 3002 in Fig. 36. Note that the 
various threshold values used for determination 
processing in the image area determining unit 3002 
are not limited to the above values, but are set in 
accordance with, e.g., the resolution of an input 
image and other states. 

The image area determination result variable 
magnification unit 3003 receives an output 3013 
(can be regarded as a binary image of the raster 
scanning scheme which has a determination result 
as a pixel value) from the image area determining 
unit 3002, magnifies the output at a desired mag- 
nification (equal to a magnification used by the 
outline variable magnification unit 3005), and out- 
puts it. The image area determination result vari- 
able magnification unit 3003 performs variable 
magnification processing of repeatedly outputting 
the same input pixel value to enlarge an image or 
thinning the same input pixel value to reduce an 
image, the number of times corresponding to a 
desired magnification. 
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The outline extraction image forming unit 3004 
reduces the number of input pixels to the outline 
variable magnification unit 3005 by using a method 
which rarely influences a variable magnification re- 
sult obtained by the outline variable magnification 
unit 3005. The outline extraction image forming unit 
3004 receives an output 3012 from the isolated 
pixel determining unit 3026 of the image area de- 
termining unit 3002, an output 3013 from the image 
area determining unit 3002, and an output 3010 
from the binary image acquiring unit 3001, and 
outputs binary image data 3015 as an input to the 
outline variable magnification unit 3005. That is, the 
outline extraction image forming unit 3004 outputs 
only the pixels of a character/line draw component 
and black pixels adjacent thereto of an input image. 

Fig. 38 shows an arrangement of the outline 
extraction image forming unit 3004. 

The outline extraction image forming unit 3004 
outputs a signal indicating a black pixel only when 
a target pixel satisfies the following three con- 
ditions. The first condition is that the target pixel 
should not be an isolated point. Information about 
this condition can .be. obtained by inverting the 
output 301 2 from the isolated pixel determining unit- 
3026 of the image area determining unit 3002. The 
second condition is that at least pne of 25 pixels in 
a 5 x 5 pixel area 3402 having a width of five pixels 
in the main scanning direction and a width of five 
pixels in the subscanning direction, with a target 
pixel 3401 in the center of the area, as shown in 
Fig. 39, should be a character/line draw compo- 
nent. A circuit for this condition can be constituted 
by a data holding unit 3043 equivalent to the one 
shown in Fig. 7, and an OR circuit 3044 for receiv- 
ing a signal corresponding to the above 25 pixels. 
The data holding unit 3043 receives a result ob- 
tained by inverting an output from the image area 
determining unit 3002 by unit of an inverter 3046, 
and outputs output inversion results, associated 
with a total of 25 pixels in the 5x5 pixel area, from 
the image area determining unit 3002. The third 
condition is that the target pixel of an input image 
should be a black pixel. Information about this 
condition can be obtained by using the output 3010 
from the image area determining unit 3002. Signals 
indicating the above three conditions are input to 
an AND circuit 3045 in synchronism . with each 
other via FIFO buffers 3042 and 3047 and a syn- 
chronization control circuit 3041. An output from 
the AND circuit 3045 is used as the output 3015 
from the outline extraction image forming unit 
3004. In this case, the second condition is de- 
scribed with reference to the 5 x 5 pixel area with a 
target pixel in the center of the area. However, the 
size of the pixel area may be changed to, e.g., a 
size of 7 x 7 pixels. 



The outline variable magnification unit 3005 will 
be described next. 

As shown in Fig. 40, the outline variable mag- 
nification unit 3005 comprises an outline extracting 
5 unit 3051, an outline smoothing/variable magnifica- 
tion unit 3052, and a binary image reproducing unit 
3053. More specifically, in the outline variable mag- 
nification unit 3005, upon reception of an output 
from the outline extraction image forming unit 
m 3004, the outline extracting unit 3051 extracts out- 
line vectors (coarse contour vectors) from this out- 
put. The outline smoothing/variable magnification 
unit 3052 then forms outline vectors which are 
smoothly magnified at a desired (arbitrary) mag- 
75 nification in the state of the extracted outline vector 
expression. The binary image reproducing unit 
3053 reproduces a binary image from the smoothly 
magnified outline vectors. With this operation, a 
high-quality image magnified at the desired mag- 
20 nification is formed. 

The scanning scheme for binary data of raster 
scanning scheme output from the outline extraction 
image forming unit 3004 in the eleventh embodi- 
ment is the same as. that- of binary, image data. 
- 25 ■ output -from the binary image-acquiring unit 11 in 
the first embodiment. In the first embodiment, how- 
ever, the binary image acquiring unit outputs an 
original image without any modification, whereas in 
the eleventh embodiment, the outline extraction 
30 image forming unit 3004 does not output ah image 
in a halftone image area. Subsequently, outline 
vector data extraction and smoothing processing 
are performed by the outline variable magnification 
unit 3005. The contents of such processing are the 
35 same as those described with reference to Figs. 15 
to 24 and 28 to 31. 

The pseudo-halftone variable magnification unit 
3006 in Fig. 35 receives an output 3011 from the 
binary image acquiring unit 3001, and outputs an 
40 image which is magnified at a desired magnifica- 
tion (equal to a magnification used by the outline 
variable magnification unit) by using a variable 
magnification method different from the outline 
variable magnification method. The pseudo-halftone 
45 variable magnification unit 3006 is identical to the 
pseudo-halftone image variable magnification unit 
14 in the first embodiment (see Fig. 8). 

The output 3017 from a pseudo-halftone pro- 
cessing unit 80 is used as an output from the 
so pseudo-halftone variable magnification unit 3006, 

Note that a . coefficient matrix in an inverse 
quantization processing unit 60 of the pseudo-hal- 
ftone variable magnification unit 3006 is not limited 
to a size of 4 x 4 pixels described with reference to 
55 Fig. 9. For example, the coefficient matrix may 
have a size of 8 x 8 or 5 x 5 pixels, as shown in 
Fig. 41, or may have a general size of m x n (m 
and n are integers) pixels such as a size of 6 x 4 
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pixels. In addition, all the coefficients need not be 
"1", but may have different values. For example, 
as shown in Fig. 42, coefficients corresponding to 
pixels closer to a target pixel may have larger 
values. If the size of a coefficient matrix is set in s 
accordance with the number of gradation levels of 
the pseudo-halftone expression of an original im- 
age, reproduction of a more faithful multivalue im- 
age can be expected. However, such an operation 
leads to an increase in cost. Therefore, it is prefer- 10 
able that the size of a coefficient matrix be properly 
selected. 

In the selecting/synthesizing unit 3007 in Fig. 
35, the outputs 3016 and 3017 from the outline 
variable magnification unit 3005 and the pseudo- is 
. halftone variable magnification unit 3006 are se- 
lected and synthesized on the basis of the output 
3014 from the image area determination result vari- 
able magnification unit 3003. 

Fig. . 43 is a block diagram showing the ar- 20 
rangement of the selecting/synthesizing unit 3007. 

Reference numeral 3072 denotes a magnified 
image area determination result buffer for holding a - 
magnified image area* determination result- (binary ' 
image data having a determination result as a pixel 25 
value) obtained from the image area determination 
result variable magnification unit 3003; 3073, an 
outline-magnified image data buffer for holding 
magnified binary image data obtained from the 
outline variable magnification unit 3005; 3074, a 30 
pseudo-halftone-magnified image data buffer for 
holding magnified binary image data obtained from 
the pseudo-halftone variable magnification unit 
3006; 3076, a synthesized image data buffer for 
temporarily holding image data obtained by select- 35 
ing/synthesizing image data from Jhe image data 
buffers 3073 and 3074; and 3071, an synchroniza- 
tion control circuit for performing synchronization 
control to read out the magnified image area deter- 
mination result in the buffer 3072, the outline-mag- 40 
nified image data in. the buffer 3073, and the pseu- 
do-halftohe-magnified image data in the buffer 
3074 according to the raster scanning scheme. The 
magnified image data read out from the buffers 
3073 and 3074 are selected/synthesized for each 45 
pair of corresponding pixels on the basis of the 
magnified image area determination result read out 
according to the raster scanning scheme. The syn- 
thesized image is temporarily stored in the syn- 
thesized image data buffer 3076. Selec- so 
tion/synthesis of magnified image data is per- 
formed by a logic circuit 3075. More specifically, 
when the magnified image area determination re- 
sult is "1" (indicating a pseudo-halftone compo- 
nent), pseudo-halftone-magnified image data is se- 55 
lected. When the magnified image area determina- 
tion result is "0" (indicating a character/line draw 
component), outline-magnified image data is se- 



lected. 

The binary image output unit 3008 in Fig. 35 is 
constituted by a hard copy unit such as a laser 
beam printer or a thermal printer, a display unit 
such as a liquid crystal display or a CRT, or the 
like, which receives an magnified image stored in 
the synthesized image data buffer 3076. The binary 
image output unit 3008 serves to display binary 
image data or record/output binary image data on a 
paper sheet as a hard copy. 

{Twelfth Embodiment) 

The binary image acquiring unit 3001 in the 
eleventh embodiment need not be an image reader 
but may be a binary image receiving unit, such as 
the receiving unit of a facsimile apparatus, which 
receives a binary image from an external unit via a 
communication unit. The binary image output unit 
3008 in the eleventh embodiment need not be a 
hard copy unit but may be a binary image transmit- 
ting unit, such as the transmitting unit of a facsimile 
apparatus, which outputs a binary image (as coded 
data)' to an external unit via a communication unit * 
The binary image output unit 3008 may be an 
interface unit for receiving a binary image from an 
external storage unit such as a magnetic disc. 

(Thirteenth Embodiment) 

In addition to the arrangement, of the eleventh 
embodiment, the present invention can be realized 
by an apparatus having an arrangement like the 
one shown in Fig. 44. That is, an output from the 
binary image acquiring unit 3001 may be directly 
input to the outline variable magnification unit 3005, 
instead of an output from the outline extraction 
image forming unit 3004, in the eleventh embodi- 
ment. In this case, the memory capacity required 
for the outline variable magnification unit 3005 and 
the processing time may be increased as com- 
pared with the eleventh embodiment. However, the 
outline extraction image forming unit 3004 is not 
required. Therefore, the apparatus arrangement ex- 
cept for the outline variable magnification unit 3005 
can be simplified, and the processing speed can 
be increased. This arrangement is especially effec- 
tive for an apparatus designed to treat an image 
having few pseudo-halftone components. 

(Fourteenth Embodiment) 

The selecting/synthesizing unit 3007 in the 
eleventh embodiment shown in Fig. 43 can also be 
reafized by the arrangement shown in Fig. 45. 

That is, the pseudo-halftone-magnified image 
data buffer 3074 and the synthesized image data 
buffer 3076 in Fig. 43 are integrated into one buffer 
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to decrease the number of buffers. 

Referring to Fig. 45, a selective write circuit 

3077 writes an output from an outline-magnified 
image data buffer 3073 in a pseudo-halftone-mag- 
nified image data/synthesized image data buffer 

3078 according to the raster scanning scheme only 
when it is determined that a target pixel is a 
character/line draw component, on the basis of an 
image area determination result output from a mag- 
nified image area determination result buffer 3072. 
In this case, although the arrangement of the circuit 
(selective write circuit 3077) for performing a se- 
lecting/synthesizing operation is complicated, the 
number of buffers can be decreased by one. 

In each embodiment described above, variable 
magnification processing performed by the pseudo- 
halftone variable- magnification unit 3006 may be 
performed by using the mean density retention 
method (MD method) described in NIKKEI ELEC- 
TRONICS. 1992. 5. 25 Issue (No. 555), pp. 207 - 
210. 

The pseudo-halftone variable magnification unit 
3006 ma/ directly magnify an input image as bi- 
nary mage data by SPC processing, insteacUof— 
temporarily converting- the input image-into mul-* 
tivalue image by inverse quantization, and may 
output binary cata obtained as a result of the SPC 
processing. 

In this case, the arrangement of the corre- 
sponding portion can be simplified so that fairly 
good image quality can be realized at a low cost. 

The present invention may be applied to a 
system constituted by a plurality of devices or an 
apparatus constituted by one device. As is appar- 
ent, the present invention can be applied to a case 
wherein the above-described effects can be ob- 
tained by supplying programs to a system or an 
apparatus. 

It is. therefore, apparent that the present inven- 
tion can be constituted by a scanner unit for read- 
ing an original image, a host computer for process- 
ing the read image data, and a printer for forming a 
corresponding output image. In addition, the 
present invention can be applied to a facsimile 
apparatus for receiving an image, performing pro- 
cessing according to this embodiment with respect 
to the input image, and outputting the processed 
image. 

Variable magnification processing in each em- 
bodiment described above is performed for pro- 
cessing (resolution conversion processing) of 
equalizing the sizes of images having different res- 
olutions, as in the case wherein an image input by 
the binary image acquiring unit 3001 is different in 
resolution from an output from the binary image 
output unit 3008, in addition to enlargement and 
reduction of images. 



As has been described above, according to 
this embodiment, when an image is to be mag- 
nified by performing proper variable magnification 
processing with respect to a character/line draw 

5 component and a pseudo-halftone component, re- 
spectively, variable magnification processing suit- 
able for the character/line draw component and 
variable magnification processing suitable for the 
pseudo-halftone component are performed with re- 

10 spect to the input image so as to form two images. 
Thereafter, the two images are select- 
ed/synthesized by image area determination. With 
this processing, a magnified image having- good 
image quality can be obtained even if a determina- 

15 tion error occurs with respect to the character/line 
draw component and the pseudo-halftone compo- 
nent. 

In addition, according to this embodiment, 
since black pixels to be input for variable mag- 
20 nification suitable for a character/line draw compo- 
nent are limited to a black pixel determined as a 
character/lihe draw component and black pixels 
adjacent thereto, variable magnification processing 

can be performed without increasing the required 

25 memory capacity and the processing time: " 
As has been described above, according to the 
present invention, even if a determination error 
occurs with respect to a character/line draw com- 
ponent and a pseudo-halftone component; a mag- 
30 nified image having good image quality can be 
obtained. 

In addition, according to the present invention, 
after two images are formed by performing variable 
magnification processing suitable for a charac- 
35 ter/line draw component and variable magnification 
processing suitable for a pseudo-halftone compo- 
nent with respect to an input image, the two im- 
ages are selected/synthesized by image area de- 
termination, thereby obtaining a magnified image 
40 having good image quality. 

Furthermore, according to the present inven- 
tion, black pixels to be input for variable magnifica- 
tion suitable for a character/line draw component 
are limited to a black pixel determined as a char- 
ts acter/line draw component and black pixels adja- 
cent thereto. Therefore, variable magnification pro- 
cessing can be performed while an increase in 
required memory capacity and processing time is 
suppressed. 

so As many apparently widely different embodi- 

ments of the present invention can be made with- 
out departing from the spirit and scope thereof, it is 
to be understood that the invention is not limited to 
the specific embodiments thereof except as de- 

55 fined in the appended -claims. .. 

In variably magnifying and outputting an image, 
proper variable magnification processing is per- 
formed with respect to a character/line draw com- 
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ponent and a pseudo-halftone component, respec- 
tively. A binary image acquired by a binary image 
acquiring unit is supplied to an image area separat- 
ing unit, in which the binary image is separated 
into a character/line draw area and a pseudo-hal- 
ftone area. An image in' the character/tine draw 
area is supplied to an outline variable magnification 
unit, which- performs extraction of outline vector 
data, smoothing processing thereof, and reproduc- 
tion processing of a binary image. An image in the 
pseudo-halftone area is supplied to a pseudo-hal- 
ftone image variable magnification unit, in which 
the image is subjected to multivalue conversion 
processing in units of pixels, variable magnification 
processing by thinning or interpolation of pixels, 
and binarization again. A synthesizing unit syn- 
thesizes binary images output from these variable 
magnification unit, and outputs the synthesized im- 
age to a binary image output unit. 

Claims 

1. An image processing apparatus_comprising: 

. -- image-area separating means -for separat- 
ing a binary image into a character/line draw 
area and a pseudo-halftone area; 

first variable magnification means for vari- 
ably magnifying an image in the character/line 
draw area, separated by said image area sepa- 
rating means, according to a scheme corre- 
sponding the character/line draw area; 

second variable magnification means for 
variably magnifying an image in the pseudo- 
halftone area, separated by said image area 
separating means, according to a scheme cor- 
responding to the pseudo-halftone area; and 

synthesizing means for synthesizing the 
images variably magnified by said first and 
second variable magnification means. 

2. The apparatus according to claim 1, wherein 
said first and second variable magnification 
means have variable magnifications set there- 
in. 

3. The apparatus according to claim 1, wherein 
said image area separating means includes 

isolated area determining means for deter- 
mining whether a target pixel is in an isolated 
pixel area, 

periodicity determining means for deter- 
mining whether a halftone pixel is present in a 
target pixel and the same binary density ap- 
pears at a predetermined pixel period, and 

high-frequency component determining 
means for determining whether a change in 
density frequently occurs between adjacent 
pixels, and 



determines, on the basis of determination 
results obtained by said isolated area deter- 
mining means, said periodicity determining 
means, and said high-frequency component 
s determining means, whether a target pixel is in 

a character/line draw area or a pseudo-halftone 
area, and separates an image area on the 
basis of the determination result. 

10 4. The apparatus according to claim 1 , wherein 
said first variable magnification means includes 
contour vector extracting means for ex- 
tracting contour vector data along an edge of a 
provided binary image, 

is smoothing means for smoothing the ex- 

tracted contour vector data, and 

means for performing variable magnifica- 
tion processing of coordinate data constituting 
the smoothed vector data, drawing contours on 

20 the basis of the coordinate data after the vari- 

able magnification processing, and filling an 
area surrounded by the contours with dots. 



5. - The apparatus according -to claim -wherein - 

25 said second variable magnification means in- 

cludes 

multivalue conversion means for convert- 
ing a target binary pixel of a provided binary 
image into multivalue pixel data on the basis of. 

30 the target pixel and a binary pixel group adja- 

cent to the target pixel, 

variable magnification means for variably, 
magnifying the multivalue pixel data obtained 
by said multivalue conversion means, and 

35 binarization means for binarizing the vari- 

ably magnified multivalue pixel data with a 
pseudo-gradation expression again.. 

6. The apparatus according to claim 1, further 
40 comprising output means for outputting the 

binary image synthesized by said synthesizing 
means. 

7. The apparatus according to claim 5, wherein 
45 said output means is a printer. 

8. The apparatus according to claim 1, wherein 
said output means is communication means for 
coding the binary image synthesized by said 

so synthesizing means and outputting the coded 

image via a line. 

9. An image processing method comprising: 

the image area separating step of separat- 
55 ing a binary image into a character/line draw 

area and a pseudo-halftone area; 

the first variable magnification step of vari- 
ably magnifying an image in the character/line 
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draw area, separated in the image area sepa- 
rating step, according to a scheme corre- 
sponding the character/line draw area; 

the second variable magnification step of 
variably magnifying an image in the pseudo- 5 
halftone area, separated in the image area 
separating step, according to a scheme cor- 
responding to the pseudo-halftone area; and 

the synthesizing step of synthesizing the 
images variably magnified in the first and sec- 10 
ond variable magnification steps. 

10. The method according to claim 9, wherein the 
image area separating step includes 

the isolated area determining step of de- 75 
termining whether a target pixel is in an iso- 
lated pixel area, 

the periodicity determining step of deter- 
mining whether a halftone pixel is present in a 
target pixel and the same binary density ap- 20 
pears at a predetermined pixel period, and 

the high-frequency component determining 
step of determining whether a change in den- 
s 'ty_ fre 9.y® n yy 9 c _cu r s be tween adjacent pixels, 
. ... .and_l; _ 25 

determines, on the basis of determination 
results obtained in the isolated area determin- 
ing step, the periodicity determining step, and 
the high-frequency component determining 
step, whether a target pixel is in a charac- 30 
ter/line draw area or a pseudo-halftone area, 
and separates an image area, on the basis of 
the determination result. 

11. The method according to claim 9, wherein the 35 
first variable magnification step includes 

the contour vector extracting step of ex- 
tracting contour vector data along an edge of a 
provided binary image, 

the smoothing step of smoothing the ex- 40 
tracted contour vector data, and 

the step of performing variable magnifica- 
tion processing of coordinate data constituting 
the smoothed vector data, drawing contours on 
the basis of the coordinate data after the vari- as 
able magnification processing, and filling an 
area surrounded by the contours with dots. 

12. The method according, to claim 9, wherein the 
second variable magnification step includes so 

; the multivalue conversion step of convert- 
ing a target binary pixel of a provided binary 
image into multivalue pixel data on the basis of 
the target pixel and a binary pixel group adja- 
cent to the target pixel, 55 

the variable magnification step of variably 
magnifying the multivalue. pixel data obtained 
in the multivalue conversion step, and 



the binarization step of binarizing the vari- 
ably magnified multivalue pixel data with a 
pseudo-gradation expression again. 

13. The method according to claim 9, further com- 
prising the output step of outputting the binary 
image synthesized in the synthesizing step. 

14. The method according to claim 9, wherein the 
output step includes the step of outputting a 
synthesized image to a printer. 

15. The method according to claim 9, wherein the 
output step includes the step of coding the 
binary image synthesized in the synthesizing 
step to output the coded image to predeter- 
mined communication means via a line. 

16. An image processing apparatus comprising: 

outline extracting means for extracting a 
contour portion of a binary image as contour 
vector data; 

first smoothing means for performing 
smoothing processing with respect to the cqn- 
tour vector data; - - 

variable magnification means for variably 
magnifying the contour vector data smoothed 
by said smoothing means; 

counting means for counting contour vec- 
tors constituting one vector loop; 

second smoothing means for smoothing 
the contour vector data, magnified by said 
variable magnification means, in accordance 
with a count value obtained by said counting 
means; and 

binary' image reproducing means for re- 
producing a binary image on the basis of the 
contour vector data smoothed by said second 
smoothing means or magnified by said vari- 
able magnification means. 

17. The apparatus according to claim 16, wherein 
said second smoothing means executes 
smoothing processing with respect to input 
contour vector data when the count value ob- 
tained by said counting means is larger than a 
reference value. 

18. The - apparatus according to claim 16, wherein 
said first smoothing means obtains a corner 
portion of a contour portion of an image, and 
executes no smoothing processing with re- 
spect to the corner portion. 

19. An image processing apparatus comprising: 

outline extracting means for extracting a 
contour portion of a binary image as contour 
vector data; 
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counting means for counting contour vec- 
tors constituting one vector loop; 

first variable magnification means for per- 
forming variable magnification processing with 
respect to the contour vector data in accor- 5 
dance with a count value obtained by said 
counting means; 

first smoothing means for performing 
smoothing processing with respect to the con- 
tour vector data in accordance with the count 10 
value obtained by said counting means; 

. second variable magnification means for 
variably magnifying the contour vector data 
smoothed by said first smoothing means; 

second smoothing means for smoothing 75 
the contour vector data magnified by said sec- 
ond variable magnification means; and 

binary image reproducing means for re- 
producing a binary image on the basis of the 
contour vector data smoothed by said second 20 
smoothing means or magnified by said first 
variable magnification means. 

.20. The apparatus according -to claim 19, wherein - 

said counting means counts contour vectors 25 
constituting each contour vector loop, extract- 
ed by said outline extracting means upon out- 
line extraction processing, in units of contour 
vector loops, 

30 

21. The apparatus according to claim 20, wherein 
said first smoothing means executes smooth- 
ing processing with respect to input contour 
vector data when the count value obtained by 

said counting means is larger than a reference 35 
value. . 

22. An image processing apparatus using a high- 
image-quality resolution conversion method 
based on an outline smoothing method, com- 40 
prising: 

image input means for inputting image 
data; 

image processing means for executing im- 
age processing with respect to the image data 45 
input from said image input means; . 

. outline extracting means for extracting a 
contour portion of the image data processed 
by said image processing means as contour 
vector data; 50 

first smoothing means for performing 
smoothing processing with respect to the con- 
tour vector data; 

variable magnification means for variably 
magnifying the contour vector data smoothed 55 
by said smoothing means; 

counting means for counting contour vec- 
tors constituting one vector loop; and 

25 



second smoothing means for smoothing 
the contour vector data, magnified by said 
variable magnification means, in accordance 
with a count value obtained by said counting 
means; 

binary image reproducing means for re- 
producing a binary image on the basis of the 
contour vector data smoothed by said second 
smoothing means or magnified by said vari- 
able magnification means; and 

a high-resolution printer for printing out the 
binary image on a predetermined paper sheet. 

23. The apparatus according to claim 22, further 
comprising a modem for modulat- 
ing/demodulating image data, and a network 
control unit for transmitting/receiving a signal 
demodulated by said modem to/from a com- 
munication line. 

24. An image processing method comprising: 

the step of extracting a contour portion of 
a binary image as contour vector data; 
- the step of performing smoothing process- " 
ing with respect to the extracted contour vector 
data; 

the variable magnification step of variably 
magnifying the smoothed contour vector data; 

the step of counting contour vectors con- 
stituting one vector loop; 

the step,. of .smoothing, the , contour, vector 
data, magnified in the variable magnification 
step, in accordance with the count value; and 

the step of reproducing a binary image on 
the basis of the contour vector data which is 
smoothed or magnified in the variable mag- 
nification step. 

25. An image processing apparatus comprising: 

image area determining means for deter- 
mining whether each pixel of a binary image 
belongs to a character/line draw area or a 
pseudo-halftone area; 

first variable magnification means for vari- 
ably magnifying an area determined as a char- 
acter/line draw area by said image area deter- 
mining means; 

second variable magnification means for 
variably magnifying an area determined as a 
pseudo-halftone area by said image area de- 
termining means; and 

selecting/synthesizing means for selecting 
and synthesizing images respectively magni- 
fied by said first and second variable mag- 
nification means in accordance with a deter- 
mination result obtained by said image area 
determining means. 
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26. The apparatus according to claim 25. further 
comprising limiting means for limiting black 
pixels of an image determined as a charac- 
ter/line draw area by said image area deter- 
mining means to black pixels including a char- 5 
acter/line draw component and pixels adjacent 
thereto. 

27. The apparatus according to claim 25 t wherein 
said first and second variable magnification 10 
means perform variable magnification process- 
ing at an arbitrary magnification. 

28. The apparatus according to claim 25, wherein 
said image area determining means includes 15 
isolated pixel determining means for determin- 
ing whether a target pixel is an isolated pixel, 
isolated pixel area determining means for de- 
termining whether the target pixel is in an 
isolated pixel area, periodicity determining 20 
means for determining whether pixel values of 
pixels adjacent to the target pixel become the 
same at a predetermined pixel period, and 
high-frequency determining means for deter- 
mining whether achange in density frequency- - 25 
occurs between adjacent pixels, and deter- 
mines, on the basis of determination results 
respectively obtained by said isolated pixel 
area determining means, said isolated pixel 
area determining means, said periodicity deter- 30 
mining means, and said high-frequency com- 
ponent determining meanSi whether the target 
pixel is in a character/line draw area or a 
pseudo-halftone area. 

35 

29. The apparatus according to claim 25, wherein 
sard first variable magnification means includes 
contour vector extracting means for extracting 
contour vector data along an edge of a pro- 
vided binary image, smoothing means for 46 
smoothing the extracted contour vector data, 

and means for performing variable magnifica- 
tion processing with respect to coordinate data 
constituting the smoothed vector data, drawing 
contours on the basis : of the coordinate data 45 
after the variable magnification processing, and 
filling an area surrounded by the contours with 
dots. 

30. The apparatus according to claim 29, wherein so 
said smoothing means changes a degree of 
smoothing in accordance with a length of each 
contour vector extracted by said contour vector 
extracting means. 

55 

31. The apparatus according to claim 25, wherein 
said second variable magnification means in- 
cludes muitivalue conversion means for con- 



verting a target binary pixel of a provided 
binary image into muitivalue pixel data on the 
basis of the target pixel and a binary pixel 
group adjacent to the target pixel, and binariza- 
tion means for binarizing the muitivalue pixel 
data, obtained by said muitivalue conversion 
means, with a pseudo-halftone expression 
again. 

32. The apparatus according to claim 25, wherein 
said selecting/synthesizing means selects and 
synthesizes each pair of pixels respectively 
magnified by said first and second variable 
magnification means by using an output from 
said image area determining means. 

33. The apparatus according to claim 25, wherein 
said selecting/synthesizing means comprises 
third variable magnification means for magnify- 
ing an output from said image area determin- 
ing means at the same magnification as that 
set in said first and second variable magnifica- 
tion means. 



34. The apparatus -according to claim 25, further 
comprising output means for outputting a bi- 
nary image synthesized by said select- 
ing/synthesizing means. 

35. The apparatus according to claim 34, wherein 
said output means is communication means for 
coding the binary image synthesized by said 
selecting/synthesizing means, and outputting 
the coded image via a line. 

36. An image processing method comprising: 

the image area determining step of deter- 
mining whether each pixel of a binary image 
belongs to a character/line draw area or a 
pseudo-halftone area; 

the first variable magnification step of vari- 
ably magnifying an area determined as a char- 
acter/line draw area; 

the second variable magnification step of 
variably magnifying an area determined as a 
pseudo-halftone area; and 

the step of selecting' and synthesizing 
each pair of pixels of images respectively 
magnified in the first and second variable mag- 
nification steps by using a result obtained in 
the image area determining step. 

37. The method according to claim 36, wherein the 
black pixels,- of the image, which are to be 
variably magnified in the first variable mag- 
nification step are limited to a black pixel de- 
termined as a pixel in a character/line draw 
area by using the result in the image area 
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determining step, and black pixels adjacent the 
black pixel. 

38. The method according to claim 36, wherein a - 
magnification in each of the first and second 
variable magnification steps can be set to be 
an arbitrary value. 

39. The method according to claim 36, wherein the 
image area determining step includes the iso- 
lated central pixel determining step of deter- 
mining whether a target pixel is an isolated 
pixel, the isolated pixel area determining step 
of determining whether the target pixel is in an 
isolated pixel area, the periodicity determining 
step of determining whether pixel values be- 
come the same at a predetermined pixel pe- 
riod, and high-frequency component determin- 
ing step of determining whether a change in 
density frequency occurs between adjacent 
pixels, and determines, on the basis of deter- 
mination results respectively obtained in the 
isolated central pixel determining step, the iso- 

. . . lated pixel . area determining step, the periodic- 
ity determining step, and the high-frequency 
component determining step, whether the tar- 
get pixel is in a character/line draw area, or a 
pseudo-halftone area. 

40. The method according to claim 36, wherein the 
first variable magnification step includes the 
contour vector extracting step of extracting 
contour vector data along an edge of a pro- 
vided binary image, the smoothing step of 
smoothing the extracted contour vector data, 
and the step of performing variable magnifica- 
tion processing with respect to coordinate data 
constituting the smoothed vector data, drawing 
contours on the basis of the coordinate data 
after the variable magnification processing, and 
filling an area surrounded by the contours with 
dots. 

41. The method according to claim 36, wherein the 
smoothing step includes changing a degree of 
smoothing in accordance with a length of each 
contour vector extracted in the contour vector 
extracting step. 

42. The method according to claim 36, wherein the 
second variable magnification step includes 
the multi value conversion step of converting a 
target binary pixel of a provided binary image 
into multi value pixel data oh the basis of the 
target pixel and a binary pixel group adjacent 
to the target pixel, arid binarizatio.n step of 
binarizing the multivalue pixel data, obtained in 
the multivalue conversion step, with a pseudo- 



halftone expression again. 

43. The method according to claim 36, wherein the 
selecting/synthesizing step includes selecting 
5 and synthesizing each pair of pixels respec- 
tively magnified in the first and second variable 
magnification steps by using a result obtained 
in the image area determining step. 

io 44. The method according to claim 36, wherein the 
Selecting/synthesizing step comprises the third 
variable magnification step of magnifying a re- 
sult obtained in the image area determining 
step at the same magnification as that set in 
■ is the first and second variable magnification 

steps. 
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